-- Logs begin at Wed 2021-05-26 14:05:20 UTC, end at Wed 2021-05-26 15:20:25 UTC. --
May 26 14:49:33.906366 dv-cinder-784140-4-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 26 14:49:34.864741 dv-cinder-784140-4-iscsi neutron-server[103874]: Beware of the coming changes in the project packaging
May 26 14:49:34.865330 dv-cinder-784140-4-iscsi neutron-server[103874]: https://github.com/svinota/pyroute2/discussions/786
May 26 14:49:36.339394 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.common.config [-] Logging enabled!
May 26 14:49:36.340045 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 26 14:49:36.340138 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103874) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 26 14:49:36.343343 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.common.config [-] Logging enabled!
May 26 14:49:36.343604 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240
May 26 14:49:36.343920 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103874) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 26 14:49:36.344859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 26 14:49:36.345098 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 26 14:49:36.345457 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 26 14:49:36.345731 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 26 14:49:36.345963 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 26 14:49:36.346287 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.346590 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.346893 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.347127 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.347427 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.347724 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.348009 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.348302 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.348603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.348892 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.349186 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.349469 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.349730 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.350017 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.350310 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.350602 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.350830 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] debug                          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.351114 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.351550 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.351968 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.352252 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.352548 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.352831 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.353134 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.353419 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.353726 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.354058 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] host                           = dv-cinder-784140-4-iscsi {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.354337 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.354628 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.354921 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.355210 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.355490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.355778 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.356068 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.356347 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.356625 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.356904 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.357200 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.357490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.357815 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.358045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.358273 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.358565 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.358860 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.359147 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.359426 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.359706 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.360005 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.360264 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.360538 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.360829 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.361118 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.361409 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.361725 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.362005 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.362283 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.362558 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.362847 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.363128 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.363405 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.363683 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.363975 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.364249 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.364529 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.364830 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.365122 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.365409 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.365731 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.366013 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.366300 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.366575 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.366850 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.367127 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.367403 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.367678 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.367964 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.368241 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.369022 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.369309 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.369611 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.369906 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:36.370208 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.370511 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.370820 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.371109 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.371411 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.371697 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.371992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.372275 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.372569 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.372864 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.373158 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.373441 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.373762 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.374047 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.374346 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.374661 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.374959 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.375255 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.375537 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.375819 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.376097 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.376381 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.376672 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.376972 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.377267 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.377573 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.377851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.378149 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.378431 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.378709 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.378991 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.379288 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.379571 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.379848 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.380134 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.380418 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.380695 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.380971 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.381251 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.381565 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.381854 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.382135 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.382417 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.382699 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.382974 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.383263 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.383544 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.383824 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.384101 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.384947 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.385225 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.385506 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.385813 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.386093 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.386377 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.386657 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.386936 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.387214 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.387490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.387766 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.388044 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.388322 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.388606 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.388883 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.389163 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.389445 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.389746 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.390024 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.390320 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.390625 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.390908 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.391193 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.391477 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.391762 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.392045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.392329 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.392615 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.392899 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.393178 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.393477 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.393792 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.394086 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.394377 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.394661 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.394963 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.395246 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.395532 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.395814 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.396095 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.396390 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.396679 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.396980 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.397280 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.397603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.397905 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.398204 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.398490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.398805 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.399093 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:36.399321 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 26 14:49:36.399563 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103874) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 26 14:49:36.756810 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:49:36.757089 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:49:36.757380 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:49:36.757898 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [-] Loading core plugin: ml2
May 26 14:49:37.150972 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.151264 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.151536 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.152745 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.153049 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.153269 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.188608 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.188889 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.189159 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.202802 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.203085 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.203355 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.233115 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.233399 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.233697 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.270171 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.270452 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.270722 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.503634 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fcac6537f70> agent after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.504252 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7fcac6537f70> agent after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.504252 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7fcac6537ee0> segment precommit_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.504419 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7fcac6537e50> network precommit_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.505092 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7fcac6556a60> segment before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.630184 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> network before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.630506 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7fcac64ca1f0> agent before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.630787 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> network before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.631064 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.631335 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.631647 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> segment precommit_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.631910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> segment precommit_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.632167 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> segment after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.632421 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> segment after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.632701 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> network after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.632968 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> network precommit_delete 0 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.633227 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port provisioning_complete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.633490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.633772 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.634047 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> agent after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.634856 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> subnet after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.636165 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> subnet precommit_delete 0 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.636463 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.636740 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.637045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> segment_host_mapping after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.637410 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.637712 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.637978 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> port after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.638275 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.638533 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.638786 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7fcac6e6df10>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.639186 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.639434 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.639680 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.639922 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.640164 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.640402 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:37.640784 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 26 14:49:37.643907 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 26 14:49:37.647810 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 26 14:49:37.651553 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1200, 1249)])])
May 26 14:49:37.653187 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 26 14:49:37.653668 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 26 14:49:37.654014 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 26 14:49:37.654408 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 26 14:49:37.657334 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 26 14:49:37.657628 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 26 14:49:37.657977 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 26 14:49:37.685870 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 26 14:49:37.686316 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7fcac65f3a00>> qos_plugin after_init 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.686616 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103874) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 26 14:49:37.686980 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7fcac65f3640>> logging-plugin after_init 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.688326 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103874) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 26 14:49:37.688617 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 26 14:49:37.688868 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 26 14:49:37.692086 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fcac6396130>> floatingip before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.692370 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7fcac6396130>> port before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:37.768350 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 26 14:49:37.768541 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 26 14:49:37.768782 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 26 14:49:37.769158 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 26 14:49:37.800665 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_db.sqlalchemy.engines [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 26 14:49:38.251749 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing driver for type 'gre'
May 26 14:49:38.252268 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] gre ID ranges: [(1, 1000)]
May 26 14:49:38.410879 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing driver for type 'local'
May 26 14:49:38.411208 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing driver for type 'vlan'
May 26 14:49:38.486260 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] VlanTypeDriver initialization complete
May 26 14:49:38.486609 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing driver for type 'vxlan'
May 26 14:49:38.487107 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] vxlan ID ranges: [(1, 1000)]
May 26 14:49:38.627595 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing extension driver 'port_security'
May 26 14:49:38.628203 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.extensions.port_security [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] PortSecurityExtensionDriver initialization complete
May 26 14:49:38.628294 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing mechanism driver 'openvswitch'
May 26 14:49:38.628539 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing mechanism driver 'hyperv'
May 26 14:49:38.635664 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.plugins.ml2.plugin [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103874) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:38.636406 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac6444730>> port after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.637175 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac6444730>> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.637175 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac6444730>> port after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.637459 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac64448e0>> subnet after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.637825 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac64448e0>> subnet after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.638160 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac64448e0>> subnet after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.638533 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6550>> network after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.638864 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6550>> network after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.639200 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6550>> network after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.639566 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee67c0>> security_group after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.639900 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee67c0>> security_group after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.640228 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee67c0>> security_group after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.640593 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6a30>> security_group_rule after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.640925 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6a30>> security_group_rule after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.641251 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6a30>> security_group_rule after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.641642 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6ca0>> address_group after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.641981 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6ca0>> address_group after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.642307 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7fcac5ee6ca0>> address_group after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.642635 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] ML2 OVO RPC backend initialized. {{(pid=103874) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 26 14:49:38.643323 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> router_interface after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.643665 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> router_interface after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.644074 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> network before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.644407 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> networks before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.644744 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> port before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.645074 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> ports before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.645405 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> subnet before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.645757 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> subnets before_response 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.646094 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> network after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.646424 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> network after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.646748 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> network after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.647074 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> port after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.647402 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.647725 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> port after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.648048 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> subnet after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.648375 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> subnet after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.648701 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7fcac5ee6f40>> subnet after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.649264 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.plugin [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Modular L2 Plugin initialization complete
May 26 14:49:38.649611 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading services supported by the core plugin {{(pid=103874) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 26 14:49:38.650734 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.plugins.ml2.managers [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Got port-security extension from driver 'port_security'
May 26 14:49:38.651196 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.extensions.vlantransparent [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Disabled vlantransparent extension.
May 26 14:49:38.651683 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103874) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 26 14:49:38.651991 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: router
May 26 14:49:38.688522 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router_interface before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.688905 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_create 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.689265 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router before_create 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.689647 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router_interface before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.690010 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router_interface after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.690356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_delete 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.690703 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> floatingip after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.691053 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_create 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.691389 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.691728 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.692066 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router_gateway after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.692414 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.692808 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.693164 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7fcac65078b0> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.693494 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7fcac6507a60> port after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.693851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7fcac65079d0> subnet after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.694183 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7fcac6507940> subnetpool_address_scope after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.694521 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> port precommit_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.694863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_create 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.695222 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7fcac64ff4c0> port before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.695554 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.695900 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router after_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.696228 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_delete 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.697077 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_create 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.697422 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router_interface after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.697860 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> router precommit_update 55549900 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.698224 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7fcac5ef41f0>> network after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.699061 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Tracking information for resource: router configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:38.699384 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Tracking information for resource: floatingip configured {{(pid=103874) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 26 14:49:38.704228 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.db.l3_agentschedulers_db [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 26 14:49:38.704789 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _notify_l3_agent_port_update at 0x7fcac5e69e50> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.705136 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _notify_l3_agent_new_port at 0x7fcac5e69d30> port after_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.705478 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _notify_port_delete at 0x7fcac5e69dc0> port after_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.705846 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7fcac5e6c160> port after_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.706618 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcac5e8b9d0>> router before_create 55550100 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.706983 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcac5e8b9d0>> router precommit_delete 55550100 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.707318 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcac5e8b9d0>> router precommit_create 55550100 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.707661 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7fcac5e8b9d0>> router precommit_update 55550100 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.712282 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.provider_configuration [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service providers = [] {{(pid=103874) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 26 14:49:38.713249 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.db.servicetype_db [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103874) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 26 14:49:38.715995 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.service_base [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103874) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 26 14:49:38.716333 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.service_base [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103874) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 26 14:49:38.716668 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.service_base [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103874) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 26 14:49:38.717527 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.services.service_base [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103874) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 26 14:49:38.717909 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.services.service_base [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Default provider is not specified for service type L3_ROUTER_NAT
May 26 14:49:38.718436 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.718755 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 26 14:49:38.729003 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.729329 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: auto_allocate
May 26 14:49:38.734992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fcac5eba4c0> network precommit_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.735347 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7fcac5eba4c0> network precommit_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.735853 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.736162 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: tag
May 26 14:49:38.742822 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.743149 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: timestamp
May 26 14:49:38.746847 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.747169 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: network_ip_availability
May 26 14:49:38.752289 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5eacfd0>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.752651 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5eacfd0>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.752996 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5eacfd0>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.753725 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.754039 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: flavors
May 26 14:49:38.758833 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.759705 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading Plugin: revisions
May 26 14:49:38.763873 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103874) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 26 14:49:38.764253 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.007s {{(pid=103874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:49:38.764977 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103874) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 26 14:49:38.765304 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Initializing extension manager.
May 26 14:49:38.765827 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: __init__.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.766157 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: __pycache__ {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.766479 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.766800 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: address_group.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.767532 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.768094 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: address-group
May 26 14:49:38.768410 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: address_scope.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.769103 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.769648 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: address-scope
May 26 14:49:38.769964 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.770855 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.771365 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: router-admin-state-down-before-update
May 26 14:49:38.771676 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: agent.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.772352 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.772856 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: agent
May 26 14:49:38.773167 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: agent_resources_synced.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.774070 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.774573 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: agent-resources-synced
May 26 14:49:38.775546 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: allowedaddresspairs.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.777262 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.777807 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: allowed-address-pairs
May 26 14:49:38.778125 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: auto_allocated_topology.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.779171 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.779678 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: auto-allocated-topology
May 26 14:49:38.779992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: availability_zone.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.780656 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.781157 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: availability_zone
May 26 14:49:38.781468 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: availability_zone_filter.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.782370 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.782875 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: availability_zone_filter
May 26 14:49:38.783187 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: data_plane_status.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.784061 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.784564 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension data-plane-status not supported by any of loaded plugins
May 26 14:49:38.785126 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: default_subnetpools.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.786039 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.786546 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: default-subnetpools
May 26 14:49:38.786901 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.787632 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.788140 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: dhcp_agent_scheduler
May 26 14:49:38.788451 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: dns.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.789339 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.789872 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension dns-integration not supported by any of loaded plugins
May 26 14:49:38.790188 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: dns_domain_ports.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.791184 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.791688 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension dns-domain-ports not supported by any of loaded plugins
May 26 14:49:38.792001 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: dvr.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.792642 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.793147 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: dvr
May 26 14:49:38.793455 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: empty_string_filtering.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.794352 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.794860 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: empty-string-filtering
May 26 14:49:38.795201 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.796074 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.796571 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 26 14:49:38.796881 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.797783 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.798283 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 26 14:49:38.798599 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: external_net.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.799472 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.799978 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: external-net
May 26 14:49:38.800290 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.801161 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.801701 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: extra_dhcp_opt
May 26 14:49:38.802013 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: extraroute.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.802874 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.803376 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: extraroute
May 26 14:49:38.803685 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: extraroute_atomic.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.804669 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.805176 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: extraroute-atomic
May 26 14:49:38.805484 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: filter_validation.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.806441 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.806940 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: filter-validation
May 26 14:49:38.807249 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: fip_pf_description.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.808294 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.808800 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 26 14:49:38.809111 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: fip_port_details.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.810024 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.810526 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: fip-port-details
May 26 14:49:38.810836 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: flavors.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.812028 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.812544 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: flavors
May 26 14:49:38.812859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.814512 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.815027 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 26 14:49:38.815347 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: floatingip_pools.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.816023 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.816530 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: floatingip-pools
May 26 14:49:38.816846 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: ip_allocation.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.817771 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.818280 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension ip_allocation not supported by any of loaded plugins
May 26 14:49:38.818592 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.819480 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.819990 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: ip-substring-filtering
May 26 14:49:38.820304 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l2_adjacency.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.821193 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.822245 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension l2_adjacency not supported by any of loaded plugins
May 26 14:49:38.822558 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.823491 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.824011 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: router
May 26 14:49:38.824329 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.826601 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.827132 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 26 14:49:38.827453 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.828354 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.828872 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: ext-gw-mode
May 26 14:49:38.829191 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.830105 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.830614 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: l3-ha
May 26 14:49:38.830925 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3_flavors.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.831805 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.832310 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: l3-flavors
May 26 14:49:38.832622 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.833511 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.834036 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: l3-port-ip-change-not-allowed
May 26 14:49:38.834345 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: l3agentscheduler.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.835351 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.835860 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: l3_agent_scheduler
May 26 14:49:38.836176 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: logging.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.838257 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.838771 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension logging not supported by any of loaded plugins
May 26 14:49:38.839093 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: metering.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.839812 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.840383 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: metering
May 26 14:49:38.840702 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.841787 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.842304 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: metering_source_and_destination_fields
May 26 14:49:38.842621 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: multiprovidernet.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.843628 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.844142 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: multi-provider
May 26 14:49:38.844460 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: netmtu.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.845339 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.845877 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: net-mtu
May 26 14:49:38.846194 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: netmtu_writable.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.847077 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.847585 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: net-mtu-writable
May 26 14:49:38.847904 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: network_availability_zone.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.848553 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.849057 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: network_availability_zone
May 26 14:49:38.849373 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: network_ip_availability.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.850457 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.850977 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: network-ip-availability
May 26 14:49:38.851292 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: network_segment_range.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.852027 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.852530 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension network-segment-range not supported by any of loaded plugins
May 26 14:49:38.852901 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: pagination.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.854069 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.854393 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: pagination
May 26 14:49:38.854704 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: port_device_profile.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.855571 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.856076 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: port-device-profile
May 26 14:49:38.856387 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.857282 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.857821 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: port-mac-address-regenerate
May 26 14:49:38.858133 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.859013 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.859519 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: port-numa-affinity-policy
May 26 14:49:38.859829 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: port_resource_request.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.860704 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.861200 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension port-resource-request not supported by any of loaded plugins
May 26 14:49:38.861510 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: portbindings.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.862439 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.862945 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: binding
May 26 14:49:38.863257 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: portbindings_extended.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.864490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.865000 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: binding-extended
May 26 14:49:38.865318 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: portsecurity.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.866222 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.866729 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: port-security
May 26 14:49:38.867042 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: project_id.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.867980 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.868297 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: project-id
May 26 14:49:38.868759 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: providernet.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.869699 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.870211 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: provider
May 26 14:49:38.870522 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.873996 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.874515 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos not supported by any of loaded plugins
May 26 14:49:38.874837 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.876120 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.876565 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 26 14:49:38.876885 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.877801 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.878315 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 26 14:49:38.878632 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_default.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.879511 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.880027 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-default not supported by any of loaded plugins
May 26 14:49:38.880348 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_fip.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.880977 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.881477 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-fip not supported by any of loaded plugins
May 26 14:49:38.881816 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_gateway_ip.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.882704 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.883242 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 26 14:49:38.883555 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_port_network_policy.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.900971 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.901479 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 26 14:49:38.901826 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_rule_type_details.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.902712 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.903216 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 26 14:49:38.903530 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: qos_rules_alias.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.904532 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.905042 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension qos-rules-alias not supported by any of loaded plugins
May 26 14:49:38.905356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: quotasv2.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.906377 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.906698 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: quotas
May 26 14:49:38.907010 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: quotasv2_detail.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.908583 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.908912 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: quota_details
May 26 14:49:38.909234 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: rbac.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.910532 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.911051 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: rbac-policies
May 26 14:49:38.911367 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: rbac_address_group.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.912258 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.912774 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: rbac-address-group
May 26 14:49:38.913082 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: rbac_address_scope.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.913992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.914500 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: rbac-address-scope
May 26 14:49:38.914811 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: rbac_security_groups.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.915958 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.916583 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: rbac-security-groups
May 26 14:49:38.916896 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: rbac_subnetpool.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.917830 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.918335 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: rbac-subnetpool
May 26 14:49:38.918646 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: revisionifmatch.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.919526 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.920030 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: revision-if-match
May 26 14:49:38.920343 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: revisions.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.921427 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.921963 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: standard-attr-revisions
May 26 14:49:38.922278 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: router_availability_zone.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.922925 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.923432 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: router_availability_zone
May 26 14:49:38.923746 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: routerservicetype.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.924629 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.925134 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension router-service-type not supported by any of loaded plugins
May 26 14:49:38.925446 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.926363 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.926870 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: security-groups-normalized-cidr
May 26 14:49:38.927184 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.928071 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.928576 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: port-security-groups-filtering
May 26 14:49:38.928889 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.929801 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.930312 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: security-groups-remote-address-group
May 26 14:49:38.930625 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: securitygroup.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.940237 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.940766 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: security-group
May 26 14:49:38.941090 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: segment.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.941873 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.942380 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension segment not supported by any of loaded plugins
May 26 14:49:38.942698 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.943596 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.944102 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 26 14:49:38.944419 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: servicetype.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.945487 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.946039 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: service-type
May 26 14:49:38.946356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: sorting.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.948025 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.948346 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: sorting
May 26 14:49:38.948658 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: standard_attr_segment.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.949563 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.950077 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension standard-attr-segment not supported by any of loaded plugins
May 26 14:49:38.950391 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: standardattrdescription.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.951014 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.951520 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: standard-attr-description
May 26 14:49:38.951833 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: stateful_security_group.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.952714 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.953225 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: stateful-security-group
May 26 14:49:38.953550 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: stdattrs_common.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.954120 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 26 14:49:38.954430 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.955387 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.955897 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 26 14:49:38.956210 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnet_onboard.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.957294 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.957834 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: subnet_onboard
May 26 14:49:38.958146 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.959038 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.959545 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 26 14:49:38.959854 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnet_service_types.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.960742 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.961343 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: subnet-service-types
May 26 14:49:38.961691 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnetallocation.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.963493 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.964011 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: subnet_allocation
May 26 14:49:38.964328 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.964975 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.965482 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: subnetpool-prefix-ops
May 26 14:49:38.965819 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.966723 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.967230 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 26 14:49:38.967543 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: tagging.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.968594 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.969111 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: standard-attr-tag
May 26 14:49:38.969427 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: timestamp.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.970630 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.971143 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loaded extension: standard-attr-timestamp
May 26 14:49:38.971463 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: trunk.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.972461 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.972973 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension trunk not supported by any of loaded plugins
May 26 14:49:38.973294 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: trunk_details.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.979740 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.980243 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension trunk-details not supported by any of loaded plugins
May 26 14:49:38.980556 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: uplink_status_propagation.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.981439 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.981979 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 26 14:49:38.982296 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Loading extension file: vlantransparent.py {{(pid=103874) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 26 14:49:38.982938 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103874) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 26 14:49:38.983439 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extension vlan-transparent not supported by any of loaded plugins
May 26 14:49:38.985873 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:network
May 26 14:49:38.986590 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnet
May 26 14:49:38.988374 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnetpool
May 26 14:49:38.988975 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:port
May 26 14:49:38.990256 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.990689 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service FLAVORS assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.991302 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.991736 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.992053 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:router
May 26 14:49:38.992695 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:floatingip
May 26 14:49:38.993396 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service METERING assigned prefix: /metering {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.994850 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5d89580>> rbac-policy before_create 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.995207 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5d89580>> rbac-policy before_update 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.995549 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7fcac5d89580>> rbac-policy before_delete 55550000 {{(pid=103874) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:49:38.996679 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of CountableResource for resource:rbac_policy
May 26 14:49:38.997129 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:security_group
May 26 14:49:38.997803 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:security_group_rule
May 26 14:49:38.998529 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service CORE assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:38.998849 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnetpool
May 26 14:49:38.999172 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] subnetpool is already registered
May 26 14:49:38.999767 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service CORE assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.000085 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnetpool
May 26 14:49:39.000397 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] subnetpool is already registered
May 26 14:49:39.002965 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.003389 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service FLAVORS assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.003982 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.004393 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.004716 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:router
May 26 14:49:39.005032 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] router is already registered
May 26 14:49:39.006017 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:floatingip
May 26 14:49:39.006017 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] floatingip is already registered
May 26 14:49:39.006547 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service METERING assigned prefix: /metering {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.007214 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of CountableResource for resource:rbac_policy
May 26 14:49:39.007530 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] rbac_policy is already registered
May 26 14:49:39.008059 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:security_group
May 26 14:49:39.008374 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] security_group is already registered
May 26 14:49:39.008942 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:security_group_rule
May 26 14:49:39.009815 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] security_group_rule is already registered
May 26 14:49:39.010472 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service CORE assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.010790 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnetpool
May 26 14:49:39.011112 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] subnetpool is already registered
May 26 14:49:39.011696 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.v2.resource_helper [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Service CORE assigned prefix:  {{(pid=103874) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 26 14:49:39.012009 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Creating instance of TrackedResource for resource:subnetpool
May 26 14:49:39.012322 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING neutron.quota.resource_registry [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] subnetpool is already registered
May 26 14:49:39.012938 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: extensions {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.014437 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: address-groups {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.016048 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: address-scopes {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.017246 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: agents {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.018424 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: auto-allocated-topology {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.019664 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: availability_zones {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.020971 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: dhcp-networks {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.022468 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: dhcp-agents {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.023848 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: routers {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.026276 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: flavors {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.027435 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: service_profiles {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.028635 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: next_providers {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.030174 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: service_profiles {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.031615 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: floatingip-pools {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.032829 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: routers {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.034903 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: floatingips {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.036085 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: l3-routers {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.037498 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: l3-agents {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.038863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: metering-labels {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.040203 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: metering-label-rules {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.041639 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: network-ip-availabilities {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.042918 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: bindings {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.044559 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: quotas {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.046106 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: quotas {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.047505 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: rbac-policies {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.051910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: security-groups {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.051910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: security-group-rules {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.051910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: service-providers {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.052701 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: subnetpools {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.055121 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: subnetpools {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.057195 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.058924 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.172103 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.173974 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.175741 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.177605 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.179286 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.181915 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.183673 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.185530 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron.api.extensions [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Extended resource: tags {{(pid=103874) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 26 14:49:39.191372 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING keystonemiddleware.auth_token [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 26 14:49:39.196076 dv-cinder-784140-4-iscsi neutron-server[103874]: WARNING keystonemiddleware.auth_token [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 26 14:49:39.204899 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Acquired lock "singleton_lock" {{(pid=103874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 26 14:49:39.205368 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_concurrency.lockutils [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Releasing lock "singleton_lock" {{(pid=103874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 26 14:49:39.206008 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Starting 2 workers
May 26 14:49:39.210650 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Started child 103981 {{(pid=103874) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 26 14:49:39.215059 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Started child 103982 {{(pid=103874) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 26 14:49:39.215945 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.216635 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO neutron.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Neutron service started, listening on 0.0.0.0:9696
May 26 14:49:39.217262 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Notify callbacks [] for process, before_spawn {{(pid=103874) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.217443 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [-] (103981) wsgi starting up on http://0.0.0.0:9696
May 26 14:49:39.219696 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Starting 1 workers
May 26 14:49:39.219813 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.221113 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [-] (103982) wsgi starting up on http://0.0.0.0:9696
May 26 14:49:39.224754 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Started child 103983 {{(pid=103874) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 26 14:49:39.225250 dv-cinder-784140-4-iscsi neutron-server[103874]: INFO oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Starting 1 workers
May 26 14:49:39.228365 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] calling RpcWorker wait() {{(pid=103983) _wait /opt/stack/neutron/neutron/service.py:128}}
May 26 14:49:39.228928 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] returning from RpcWorker wait() {{(pid=103983) _wait /opt/stack/neutron/neutron/service.py:135}}
May 26 14:49:39.229623 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Started child 103984 {{(pid=103874) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 26 14:49:39.230234 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.230411 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG neutron_lib.callbacks.manager [None req-d9ce2330-6f87-444e-95e7-ea286e650520 None None] Notify callbacks [] for process, after_spawn {{(pid=103874) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.230797 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:39.232274 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103874) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 26 14:49:39.232489 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 26 14:49:39.232676 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 26 14:49:39.232894 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 26 14:49:39.233224 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 26 14:49:39.233388 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 26 14:49:39.233910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.234190 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.234477 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.234586 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:39.235029 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.235029 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.235584 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.235838 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.236080 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.236359 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.236610 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.236787 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.236951 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.237199 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.237428 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.237787 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.238042 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.238301 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.238574 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.238743 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.238997 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.239258 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.239485 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.239756 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] debug                          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.240006 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.240487 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.240714 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.240967 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.241235 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.241501 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.241788 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.242067 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.242318 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.242557 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.242765 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.243024 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.243270 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.244044 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.244286 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.244625 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.244852 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.245362 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] host                           = dv-cinder-784140-4-iscsi {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.245646 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.245874 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.246126 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.246389 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.246650 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.246872 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.247129 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.247389 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.247634 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.247878 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.248109 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.248365 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.248602 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.248849 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.249015 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.249267 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.249576 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.249844 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.250034 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.250203 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.250385 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.250643 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.250805 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.251057 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.251282 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.251494 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.251706 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.251940 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.252155 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.252414 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.252656 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.252893 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.253102 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.253352 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.253604 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.253835 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.254067 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.254310 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.254529 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.254745 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.254964 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.255213 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.255445 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.255659 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.255918 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.256150 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.256409 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.256652 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.256898 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.257130 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.257356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.257602 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.257859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.258091 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.258331 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.258576 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.258798 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.259105 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.259850 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.260083 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.260512 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.260716 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.260955 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.261223 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.261459 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.261691 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.261907 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.262127 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.262359 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.262974 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.263127 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:39.263292 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.263459 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.263600 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.263856 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.264054 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.264277 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.264496 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.264747 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.264982 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.265320 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.265579 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.265876 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.266113 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.266349 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.266680 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.266944 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.267231 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.267471 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.267710 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.267943 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.268183 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.268513 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.268773 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.269046 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.81/identity {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.269306 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.269521 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.269764 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.269995 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.270228 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.270465 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.273443 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.274185 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.276863 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.277514 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.277514 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.277514 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.277746 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.277927 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.281050 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.281312 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.281573 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.281822 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.282920 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.285874 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.286168 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.286992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.286992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.286992 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.287622 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.287622 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.287622 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.288045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.288045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.288308 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.288538 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.288674 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.289206 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.289206 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.289507 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.289507 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.289894 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.290043 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.290476 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.290779 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.291049 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.291311 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.291563 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.291809 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.292069 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.292301 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293013 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293013 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293296 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293296 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293556 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.293829 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.294087 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.294375 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.294622 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.294896 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.295122 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.295367 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.295614 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.295901 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.296144 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.296539 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.296850 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.297183 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.297467 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.297746 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.298052 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.298279 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.298555 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.298859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.299144 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.299408 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.299664 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.300113 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.300475 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.300795 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.301125 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.301441 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.301806 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.302068 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.302356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.302604 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.302834 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.303081 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.303316 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.303625 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.303859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.304078 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.304300 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.304570 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.304834 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.305079 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.305336 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.305602 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.306673 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.307127 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.307569 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.81/identity {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.307809 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.308029 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.308264 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.308482 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.308732 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.308967 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.309207 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.309448 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.309696 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.309948 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.310166 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.310388 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.310620 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.310858 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.311098 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.311347 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.311566 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.311791 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.312037 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.312277 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.312498 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.312739 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.312953 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.313206 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.313427 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.313729 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.314005 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.314242 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.314490 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.314749 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.314996 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.315212 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.315461 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.315703 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.315924 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.316135 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.316569 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.316809 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.317047 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.317297 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.317517 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.317792 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.318204 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.318527 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.318797 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.319028 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.319279 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.319496 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.319733 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.319983 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.320203 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.320417 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.320637 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.320852 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.321108 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.321348 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.322219 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.322463 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.322682 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.322889 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.323107 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.323319 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.323621 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.323871 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.324105 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.324360 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.324596 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.324846 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.325064 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.325276 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.325493 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.325747 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.326001 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.326211 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.326426 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.326642 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.326851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.327077 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.327307 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.327522 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.327823 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.328167 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.328401 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.328621 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.329076 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.329301 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.329561 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.329882 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.330322 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.330733 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.331104 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.331420 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.331653 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.331928 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.332281 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.332496 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.332741 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.332963 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.333184 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.333425 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.333707 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.334023 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.334322 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.334591 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.334847 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.335130 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.335421 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1200:1249'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.335697 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.335917 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.336222 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.336558 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.336834 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.337095 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.337390 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.337740 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.338123 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.338375 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.338610 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.338851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.339070 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.339334 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.339572 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.339803 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.340021 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.340252 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.340489 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.340747 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.340982 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.341225 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.341463 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.341648 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 26 14:49:39.342257 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103874) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 26 14:49:39.342420 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 26 14:49:39.342571 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 26 14:49:39.342733 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 26 14:49:39.342901 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 26 14:49:39.343052 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 26 14:49:39.343258 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.343420 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.343579 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.343736 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.343894 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.344073 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.344237 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.344391 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.344705 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.344867 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345023 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345180 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345337 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345500 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345673 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345830 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.345988 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.346148 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.346324 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.346466 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.346795 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.346955 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347089 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] debug                          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347241 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347414 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347574 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347713 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.347851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348010 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348157 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348312 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348469 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348626 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348784 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.348941 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349089 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349226 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349382 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349626 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349764 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.349901 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] host                           = dv-cinder-784140-4-iscsi {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350038 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350173 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350308 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350442 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350588 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350740 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.350882 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351042 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351198 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351354 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351511 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351667 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351824 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.351981 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352138 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352296 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352451 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352607 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352810 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.352981 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.353239 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.353401 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.353630 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.353746 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.353881 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354038 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354196 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354353 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354510 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354668 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354825 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.354982 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355138 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355295 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355451 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355611 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355770 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.355924 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.356082 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.356244 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.356479 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.356609 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.356800 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357006 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357204 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357368 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357523 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357694 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.357851 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.358008 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.358237 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.358667 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.358800 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.358926 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359071 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359155 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359281 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359442 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359598 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359755 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.359910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360067 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360223 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360381 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360592 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360720 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.360877 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.361033 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.361235 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 26 14:49:39.361356 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.361504 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.361699 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.361860 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362019 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362178 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362337 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362497 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362657 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362816 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.362983 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363142 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363311 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363471 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363632 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363796 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.363956 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364116 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364277 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364437 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364596 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364755 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.364931 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365091 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365252 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.81/identity {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365411 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365590 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365751 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.365913 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366074 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366235 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366396 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366569 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366711 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366888 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.366991 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367148 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367308 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367469 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367631 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367791 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.367951 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.368111 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.368272 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.368986 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369163 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369310 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369657 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369657 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369823 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.369950 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370110 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370270 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370429 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370589 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370750 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.370910 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371076 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371235 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371395 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371554 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371727 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.371886 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372046 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372206 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372367 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372527 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372687 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.372848 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373009 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373168 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373327 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373487 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373666 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373826 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.373987 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374146 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374306 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374467 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374626 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374786 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.374944 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375104 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375839 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.375967 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376050 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376182 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376340 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376499 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376658 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376817 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.376977 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377137 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377297 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377459 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377656 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377789 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.377947 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378106 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378193 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:39.378285 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378412 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378572 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378731 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.378892 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379050 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379209 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379369 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379527 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379695 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.379856 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380018 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380177 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380343 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380514 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380673 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380835 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.380994 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381157 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381316 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381475 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381655 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381814 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.381974 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382134 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382300 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382471 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382631 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382790 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.382949 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383131 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383292 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383451 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383611 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383770 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.383929 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.384777 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.384943 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.385213 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.385380 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.385579 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.385721 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.81/identity {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.385880 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386040 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386200 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386359 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386521 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386681 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386829 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.386990 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387150 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387309 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387470 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387629 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387787 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.387947 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388106 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388266 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388425 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388583 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388742 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.388900 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389060 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389219 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389377 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389553 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389717 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.389879 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.390039 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.390200 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.390360 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.390521 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.390681 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.391520 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.391688 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.391850 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392014 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392243 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392332 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392455 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392612 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392772 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.392932 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393091 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393250 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393424 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393603 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393766 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.393927 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394086 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394246 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394406 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394566 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394725 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.394885 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395044 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395206 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395445 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395613 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395772 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.395933 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396093 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396254 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396415 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396587 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396748 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.396908 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397068 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397226 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397396 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397570 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397736 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.397896 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398056 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398224 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398383 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398542 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398700 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.398859 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.399029 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.399188 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.399346 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.399505 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.399697 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400058 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400230 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400390 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400550 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400709 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.400878 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401039 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401199 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401366 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401530 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401836 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.401997 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402170 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402329 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402493 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402653 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402812 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.402972 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403133 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403297 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403467 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403634 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403795 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.403963 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404131 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1200:1249'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404300 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404461 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404628 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404799 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.404958 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405120 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405280 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405439 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405619 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405779 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.405937 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406095 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406253 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406412 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406570 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406728 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.406887 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407045 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407204 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407363 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407526 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407688 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407831 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 26 14:49:39.407984 dv-cinder-784140-4-iscsi neutron-server[103874]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 26 14:49:39.580536 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52248) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:49:39.589011 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [-] 10.222.0.81 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0063903
May 26 14:49:50.549110 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9472ce0f-89ce-4b74-990a-3df78c51e401 None None] get_active_networks_info from dv-cinder-784140-4-iscsi {{(pid=103983) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 26 14:49:50.656347 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9472ce0f-89ce-4b74-990a-3df78c51e401 None None] No non-hosted networks {{(pid=103983) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 26 14:49:50.663187 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.agentschedulers_db [None req-9472ce0f-89ce-4b74-990a-3df78c51e401 None None] DHCP Agent not found on host dv-cinder-784140-4-iscsi {{(pid=103983) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 26 14:49:50.799085 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-73f8800c-6509-4441-9fdf-6fc1d82c5712 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:53.096354 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:53.097851 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.098418 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.098965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.099523 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.100055 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.100617 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.101162 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.101755 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.102828 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.103422 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.104108 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.104603 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:49:53.106001 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fcac5160d90>, 'Open vSwitch agent', 'dv-cinder-784140-4-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:53.122092 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7fcac5105400>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-784140-4-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:49:53.154745 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7dd3d65d-4175-4f76-9952-33bb0da16f72 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:53.199380 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-08c96fb1-1d46-46d4-944b-e5391b83d22b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:54.046427 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:55.572459 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:49:57.057885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52342) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:49:57.654173 dv-cinder-784140-4-iscsi neutron-server[103982]: WARNING oslo_policy.policy [None req-a00e9259-7e64-4827-acc9-7e3c4dd6f1ea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:49:57.654754 dv-cinder-784140-4-iscsi neutron-server[103982]: WARNING oslo_policy.policy [None req-a00e9259-7e64-4827-acc9-7e3c4dd6f1ea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:49:57.878947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [None req-a00e9259-7e64-4827-acc9-7e3c4dd6f1ea admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:49:57.879898 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a00e9259-7e64-4827-acc9-7e3c4dd6f1ea admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8210292
May 26 14:49:58.145384 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.db.l3_hamode_db [None req-b6e5c364-2ee4-4100-80a9-b9fc0364b096 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 26 14:49:58.231618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6e5c364-2ee4-4100-80a9-b9fc0364b096 None None] Routers set() bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:49:58.231974 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6e5c364-2ee4-4100-80a9-b9fc0364b096 None None] Router IDs set() for agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 26 14:50:00.219875 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52356) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:00.583346 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'is_default': True, 'shared': True}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:00.684669 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.policy [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103982) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 26 14:50:00.729990 dv-cinder-784140-4-iscsi neutron-server[103982]: WARNING oslo_policy.policy [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:00.730349 dv-cinder-784140-4-iscsi neutron-server[103982]: WARNING oslo_policy.policy [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:00.738788 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.quota [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fcac57cbcd0>.
May 26 14:50:00.754470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:00.892137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804598714', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804598041', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804570883', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804581591', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804361333', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8781804367888', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-744086', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-698644', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3827736', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3755453'] for rbac-policy, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:01.074503 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:01.075578 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-173e8630-9bf7-423c-86ba-22f72e4f87f8 admin admin] 10.222.0.81 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.8547685
May 26 14:50:03.645964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52370) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:03.996456 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Request body: {'network': {'name': 'private', 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:04.001257 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:04.005809 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Usage tracker for resource:network and tenant:b54e97f29d114770becbf544bc62ec8c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:04.011077 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:04.017350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:04.084680 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Made reservation on behalf of b54e97f29d114770becbf544bc62ec8c for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:50:04.087542 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.112027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.119509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:04.123136 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Usage tracker for resource:security_group_rule and tenant:b54e97f29d114770becbf544bc62ec8c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:04.128053 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:04.134350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:04.228779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.290966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.295301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:04.314196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1229}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:50:04.339598 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8781805467630', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.340205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fcac6537ee0> segment precommit_create {{(pid=103982) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 26 14:50:04.340686 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Added segment 0fcc3b29-34ee-402f-bfeb-920c16ed1d01 of type vlan for network 5e578773-4e76-4ff9-89c5-710d7a80ed8b
May 26 14:50:04.389260 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eff34000-9eb2-4e37-92fa-36fd301daeac,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:04.410146 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.410497 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.410821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.411140 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.411515 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.411846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.412164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.412490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.412819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.413128 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.413432 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.413758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Tracked resource versions report:
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]: pushed versions:
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]: {   'AddressGroup': {'1.2'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'ConntrackHelper': {'1.0'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Log': {'1.0'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Network': {'1.1'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Port': {'1.7'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'PortForwarding': {'1.2'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'QosPolicy': {'1.8'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SecurityGroup': {'1.4'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SecurityGroupRule': {'1.2'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SubPort': {'1.0'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Subnet': {'1.1'},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Trunk': {'1.1'}}
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]: consumer versions:
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'ConntrackHelper': '1.0',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Log': '1.0',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Network': '1.1',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Port': '1.7',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'PortForwarding': '1.2',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'QosPolicy': '1.8',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SecurityGroup': '1.4',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SecurityGroupRule': '1.2',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SubPort': '1.0',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Subnet': '1.1',
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Trunk': '1.1'}}
May 26 14:50:04.415528 dv-cinder-784140-4-iscsi neutron-server[103982]:  {{(pid=103982) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:50:04.462736 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.466603 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:04.549009 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.550542 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:04.551219 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:04.555863 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:04.659496 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Pushing event updated for resources: {'Network': ['ID=5e578773-4e76-4ff9-89c5-710d7a80ed8b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:04.663339 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:04.671620 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:50:04.698336 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 850 time: 1.0513043
May 26 14:50:07.360889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52386) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:07.821756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6393c74-b625-4c3a-9713-85590e43d43a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:07.823038 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-c6393c74-b625-4c3a-9713-85590e43d43a admin admin] 10.222.0.81 "GET /v2.0/networks/5e578773-4e76-4ff9-89c5-710d7a80ed8b HTTP/1.1" status: 200  len: 826 time: 0.4612112
May 26 14:50:07.850068 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-67806282-e9b6-4029-9082-8257b1fca13f admin admin] 10.222.0.81 "GET /v2.0/subnetpools/1194c304-cf44-4c6b-9a4f-2169b160b8e6 HTTP/1.1" status: 200  len: 734 time: 0.0216885
May 26 14:50:07.858799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Request body: {'subnet': {'name': 'private-subnet', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6', 'ip_version': 4, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'gateway_ip': '172.20.0.1'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:07.862844 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:07.866519 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Usage tracker for resource:subnet and tenant:b54e97f29d114770becbf544bc62ec8c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:07.869587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:07.875095 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:07.965756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Made reservation on behalf of b54e97f29d114770becbf544bc62ec8c for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:50:07.968022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:08.512303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:08.516173 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:08.597072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Pushing event updated for resources: {'Subnet': ['ID=23ab9d0a-3872-4e31-8743-9a3fade91b8e,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:08.601178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Checking segment: {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:50:08.601561 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Network hostable DHCP agents. Network: 5e578773-4e76-4ff9-89c5-710d7a80ed8b, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:50:08.605250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:08.678784 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:50:08.766376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 5e578773-4e76-4ff9-89c5-710d7a80ed8b) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:08.771667 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:08.773065 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:08.775130 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46db3b8d-2130-4249-853b-0c53a24f4f77 None None] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:50:08.835549 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.9799738
May 26 14:50:09.089109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 14:50:09.090310 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.275413 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Allocated IP 172.20.0.2 (5e578773-4e76-4ff9-89c5-710d7a80ed8b/23ab9d0a-3872-4e31-8743-9a3fade91b8e/7354a3f8-a41e-413e-a9e3-0af325ac3f23) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:50:09.506422 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.519806 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Transition to ACTIVE for port object 7354a3f8-a41e-413e-a9e3-0af325ac3f23 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:50:09.543067 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Transition to ACTIVE for port object 7354a3f8-a41e-413e-a9e3-0af325ac3f23 will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:50:09.612453 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.617776 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:09.680362 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:50:09.683150 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:09.688716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:50:09.723381 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Pushing event updated for resources: {'Port': ['ID=7354a3f8-a41e-413e-a9e3-0af325ac3f23,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:09.734818 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.735162 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.735487 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.735802 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.736113 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.736426 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.736732 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.737038 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.737357 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.737692 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.737994 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.738294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Tracked resource versions report:
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]: pushed versions:
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]: {   'AddressGroup': {'1.2'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'ConntrackHelper': {'1.0'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Log': {'1.0'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Network': {'1.1'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Port': {'1.7'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'PortForwarding': {'1.2'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'QosPolicy': {'1.8'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SecurityGroup': {'1.4'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SecurityGroupRule': {'1.2'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SubPort': {'1.0'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Subnet': {'1.1'},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Trunk': {'1.1'}}
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]: consumer versions:
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'ConntrackHelper': '1.0',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Log': '1.0',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Network': '1.1',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Port': '1.7',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'PortForwarding': '1.2',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'QosPolicy': '1.8',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SecurityGroup': '1.4',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SecurityGroupRule': '1.2',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SubPort': '1.0',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Subnet': '1.1',
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Trunk': '1.1'}}
May 26 14:50:09.739396 dv-cinder-784140-4-iscsi neutron-server[103983]:  {{(pid=103983) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:50:09.772401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:09.797693 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Attempting to bind port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:50:09.798256 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Attempting to bind port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:50:09.798420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Attempting to bind port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 on network 5e578773-4e76-4ff9-89c5-710d7a80ed8b {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:50:09.803651 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 49, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:50:09.804045 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Checking segment: {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:50:09.804504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.805401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Bound using segment: {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:50:09.805956 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Bound port: 7354a3f8-a41e-413e-a9e3-0af325ac3f23, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:50:09.806306 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.892460 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] For port 7354a3f8-a41e-413e-a9e3-0af325ac3f23, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:50:09.896374 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] For port 7354a3f8-a41e-413e-a9e3-0af325ac3f23, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7354a3f8-a41e-413e-a9e3-0af325ac3f23,segment=NetworkSegment(0fcc3b29-34ee-402f-bfeb-920c16ed1d01),segment_id=0fcc3b29-34ee-402f-bfeb-920c16ed1d01)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:50:09.955088 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:09.960110 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:10.056057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Pushing event updated for resources: {'Port': ['ID=7354a3f8-a41e-413e-a9e3-0af325ac3f23,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:10.056057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:11.213425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52396) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:11.587688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [None req-b231c076-ebc2-4103-930b-fa193f20f226 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:50:11.588679 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b231c076-ebc2-4103-930b-fa193f20f226 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3742454
May 26 14:50:13.944560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52406) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:14.573500 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING oslo_policy.policy [None req-d754c2fe-8949-4eb5-b15a-dec015141cda admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:14.574095 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING oslo_policy.policy [None req-d754c2fe-8949-4eb5-b15a-dec015141cda admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:14.794322 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [None req-d754c2fe-8949-4eb5-b15a-dec015141cda admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103981) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:50:14.795548 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d754c2fe-8949-4eb5-b15a-dec015141cda admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8487422
May 26 14:50:14.952206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7354a3f8-a41e-413e-a9e3-0af325ac3f23 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:15.086012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:50:15.570842 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c2d82c21-9cfa-4558-9c9e-c458e6adf359 None None] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:50:15.733401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Provisioning for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:50:15.745699 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Provisioning complete for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:15.746099 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:15.927973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:15.965655 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] For port 7354a3f8-a41e-413e-a9e3-0af325ac3f23, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7354a3f8-a41e-413e-a9e3-0af325ac3f23,segment=NetworkSegment(0fcc3b29-34ee-402f-bfeb-920c16ed1d01),segment_id=0fcc3b29-34ee-402f-bfeb-920c16ed1d01)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:50:16.035244 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:16.038573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:16.111188 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Pushing event updated for resources: {'Port': ['ID=7354a3f8-a41e-413e-a9e3-0af325ac3f23,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:16.114342 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:16.155147 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-fb9d502b-af5f-4332-99e7-dcfb3820efab None None] Provisioning complete for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:16.155515 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-fb9d502b-af5f-4332-99e7-dcfb3820efab None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:16.932033 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7354a3f8-a41e-413e-a9e3-0af325ac3f23 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:16.997293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:16.998021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:17.423920 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52426) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:17.778569 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'name': 'router1'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:17.849871 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.policy [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103981) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 26 14:50:17.897004 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING oslo_policy.policy [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:17.897699 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING oslo_policy.policy [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 26 14:50:17.905924 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.quota [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7fcac5863b20>.
May 26 14:50:17.922184 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:17.928704 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Usage tracker for resource:router and tenant:b54e97f29d114770becbf544bc62ec8c is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:17.936093 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:17.941061 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:18.023266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:18.025845 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:18.051344 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:18.206751 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:18.297071 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:18.298232 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6b4af3e9-c439-4fd2-a3e3-5ff66ad6a87a admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.8733656
May 26 14:50:20.526489 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7791fe4e-770f-4785-a8b5-2eb64180aea3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:20.625008 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52438) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:20.986854 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [None req-f5e38a41-edd4-4d61-89e8-006deecc85b4 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:50:20.987865 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f5e38a41-edd4-4d61-89e8-006deecc85b4 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3619039
May 26 14:50:23.090295 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:23.125964 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-be1eaf96-a0c1-4968-8396-4bae0773efa2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:23.339665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52448) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:23.710228 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Request body: {'network': {'router:external': True, 'name': 'public', 'is_default': True, 'admin_state_up': True, 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:23.715658 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:23.719608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Usage tracker for resource:network and tenant:75bc8650bf2341bf9ded2f24a62fd9b6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:23.722953 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:23.728603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:23.811428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Made reservation on behalf of 75bc8650bf2341bf9ded2f24a62fd9b6 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:50:23.814407 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:23.832361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:23.847054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:23.850745 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Usage tracker for resource:security_group_rule and tenant:75bc8650bf2341bf9ded2f24a62fd9b6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:23.853934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:23.859522 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:23.952830 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:23.976169 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.250346 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.255779 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:24.269308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Reserving flat network on physical network physnet1 {{(pid=103981) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 26 14:50:24.299128 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8781805467630', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.299709 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7fcac6537ee0> segment precommit_create {{(pid=103981) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 26 14:50:24.300183 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Added segment 3911e6c6-a3f2-4d55-9830-82a3b81724ae of type flat for network 0090f6f3-94b8-4606-8d1e-abbe36685c7a
May 26 14:50:24.348801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20132520-ecee-4947-9645-7f8bdf9a7a50,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:24.363121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.363460 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.363782 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.364095 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.364408 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.364727 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.365033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.365348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.365693 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.365993 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.366290 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.366584 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Tracked resource versions report:
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]: pushed versions:
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]: {   'AddressGroup': {'1.2'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'ConntrackHelper': {'1.0'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Log': {'1.0'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Network': {'1.1'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Port': {'1.7'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'PortForwarding': {'1.2'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'QosPolicy': {'1.8'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SecurityGroup': {'1.4'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SecurityGroupRule': {'1.2'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SubPort': {'1.0'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Subnet': {'1.1'},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Trunk': {'1.1'}}
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]: consumer versions:
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'ConntrackHelper': '1.0',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Log': '1.0',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Network': '1.1',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Port': '1.7',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'PortForwarding': '1.2',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'QosPolicy': '1.8',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SecurityGroup': '1.4',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SecurityGroupRule': '1.2',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SubPort': '1.0',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Subnet': '1.1',
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Trunk': '1.1'}}
May 26 14:50:24.368206 dv-cinder-784140-4-iscsi neutron-server[103981]:  {{(pid=103981) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:50:24.422536 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:24.424174 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.543190 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.544747 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:24.545389 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:24.550203 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:24.653327 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Pushing event updated for resources: {'Network': ['ID=0090f6f3-94b8-4606-8d1e-abbe36685c7a,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:24.656644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:24.664243 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:50:24.698297 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 1.3575845
May 26 14:50:25.518798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:27.172057 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52472) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:27.397229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0de4f75c-8b2f-47a5-a60b-af7810458f9f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:27.399202 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0de4f75c-8b2f-47a5-a60b-af7810458f9f admin admin] 10.222.0.81 "GET /v2.0/subnets/23ab9d0a-3872-4e31-8743-9a3fade91b8e HTTP/1.1" status: 200  len: 849 time: 0.2261767
May 26 14:50:27.561400 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1db44ff2-ffa4-4ee3-acac-5feb14bd728a admin admin] 10.222.0.81 "GET /v2.0/routers/9cdbba0a-b830-43f6-8668-c571e7e91233 HTTP/1.1" status: 200  len: 704 time: 0.1565259
May 26 14:50:28.026768 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:28.256782 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Allocated IP 172.20.0.1 (5e578773-4e76-4ff9-89c5-710d7a80ed8b/23ab9d0a-3872-4e31-8743-9a3fade91b8e/6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:50:28.409361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:28.427329 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Transition to ACTIVE for port object 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:50:28.555264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:28.560028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:28.621151 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:50:28.623961 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:28.629046 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:50:28.639413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:28.766995 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Pushing event updated for resources: {'Port': ['ID=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:28.779301 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:28.943627 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-b841a741-ad50-4a87-8037-41ca6999b904 None None] Provisioning for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:50:28.949629 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-b841a741-ad50-4a87-8037-41ca6999b904 None None] Provisioning complete for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:28.950101 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b841a741-ad50-4a87-8037-41ca6999b904 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:28.994232 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:29.003432 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-b841a741-ad50-4a87-8037-41ca6999b904 None None] Port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:50:29.220701 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:29.274742 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:29.275838 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:29.279199 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:29.411219 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Pushing event updated for resources: {'Port': ['ID=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:29.415567 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:29.473310 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:50:29.474303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:29.624581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-dccc31cd-d641-4d35-a1d4-9e402ca64e28 None None] Provisioning complete for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:29.624945 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-dccc31cd-d641-4d35-a1d4-9e402ca64e28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:29.702752 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-dccc31cd-d641-4d35-a1d4-9e402ca64e28 None None] Port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:50:29.720088 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Router 9cdbba0a-b830-43f6-8668-c571e7e91233 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103981) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 14:50:29.874486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:50:29.884051 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] 10.222.0.81 "PUT /v2.0/routers/9cdbba0a-b830-43f6-8668-c571e7e91233/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.3177965
May 26 14:50:29.884394 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Sync routers for ids ['9cdbba0a-b830-43f6-8668-c571e7e91233'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:50:29.894728 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Routers {'9cdbba0a-b830-43f6-8668-c571e7e91233'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:50:29.898970 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac592f9d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9cdbba0a-b830-43f6-8668-c571e7e91233'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:30.070559 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Set router 9cdbba0a-b830-43f6-8668-c571e7e91233 gateway port host: None {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:50:30.433320 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac592f9d0>, [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:28Z', 'revision_number': 2, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port_host': None, '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:29Z', 'revision_number': 2, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:30.438212 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Checking router: 9cdbba0a-b830-43f6-8668-c571e7e91233 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:50:30.438581 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Updating router 9cdbba0a-b830-43f6-8668-c571e7e91233 port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:50:30.493615 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:30.870389 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:30.886749 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Transition to ACTIVE for port object 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:50:30.960409 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:30.967360 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:31.177160 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Pushing event updated for resources: {'Port': ['ID=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:31.186554 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Attempting to bind port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:50:31.186931 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Attempting to bind port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:50:31.187352 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Attempting to bind port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 on network 5e578773-4e76-4ff9-89c5-710d7a80ed8b {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:50:31.191201 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.191536 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.191858 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.192175 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.192487 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.192795 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.193101 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.193406 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.193750 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.194059 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.194360 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.194660 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Tracked resource versions report:
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]: pushed versions:
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]: {   'AddressGroup': {'1.2'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'ConntrackHelper': {'1.0'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Log': {'1.0'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Network': {'1.1'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Port': {'1.7'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'PortForwarding': {'1.2'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'QosPolicy': {'1.8'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SecurityGroup': {'1.4'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SecurityGroupRule': {'1.2'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SubPort': {'1.0'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Subnet': {'1.1'},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Trunk': {'1.1'}}
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]: consumer versions:
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'ConntrackHelper': '1.0',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Log': '1.0',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Network': '1.1',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Port': '1.7',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'PortForwarding': '1.2',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'QosPolicy': '1.8',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SecurityGroup': '1.4',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SecurityGroupRule': '1.2',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SubPort': '1.0',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Subnet': '1.1',
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Trunk': '1.1'}}
May 26 14:50:31.195827 dv-cinder-784140-4-iscsi neutron-server[103984]:  {{(pid=103984) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:50:31.200161 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 50, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:50:31.200569 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Checking segment: {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:50:31.201031 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:31.201403 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Bound using segment: {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:50:31.201946 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Bound port: 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0fcc3b29-34ee-402f-bfeb-920c16ed1d01', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:50:31.202331 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:31.211173 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:31.298303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] For port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:50:31.298303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] For port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,segment=NetworkSegment(0fcc3b29-34ee-402f-bfeb-920c16ed1d01),segment_id=0fcc3b29-34ee-402f-bfeb-920c16ed1d01)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:50:31.360550 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:31.365529 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:31.453097 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Pushing event updated for resources: {'Port': ['ID=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:31.456875 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:31.458530 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Routers {'9cdbba0a-b830-43f6-8668-c571e7e91233'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:50:31.459147 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac592f9d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9cdbba0a-b830-43f6-8668-c571e7e91233'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:31.642173 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] Set router 9cdbba0a-b830-43f6-8668-c571e7e91233 gateway port host: None {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:50:31.973177 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac592f9d0>, [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:28Z', 'revision_number': 2, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port_host': None, '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:31Z', 'revision_number': 4, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:31.977900 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4542bc26-f8d9-4ee4-9447-c4b4ca03bccc None None] The sync data for ids ['9cdbba0a-b830-43f6-8668-c571e7e91233'] in dv-cinder-784140-4-iscsi is: [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:28Z', 'revision_number': 2, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port_host': None, '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:31Z', 'revision_number': 4, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:50:32.050333 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52494) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:32.195876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-26493929-6e98-4d6f-b53d-1f9d2ab3f2bc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:32.196430 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-26493929-6e98-4d6f-b53d-1f9d2ab3f2bc admin admin] Synchronizing usage tracker for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:network {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:50:32.286149 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-26493929-6e98-4d6f-b53d-1f9d2ab3f2bc admin admin] Unset dirty status for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:network {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:50:32.287259 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-26493929-6e98-4d6f-b53d-1f9d2ab3f2bc admin admin] 10.222.0.81 "GET /v2.0/networks/0090f6f3-94b8-4606-8d1e-abbe36685c7a HTTP/1.1" status: 200  len: 842 time: 0.2359819
May 26 14:50:32.297413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Request body: {'subnet': {'gateway_ip': '172.27.2.1', 'name': 'public-subnet', 'ip_version': 4, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'enable_dhcp': False, 'cidr': '172.27.2.0/24'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:32.302752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:50:32.306794 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Usage tracker for resource:subnet and tenant:75bc8650bf2341bf9ded2f24a62fd9b6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:50:32.309836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:50:32.316063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:50:32.400270 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Made reservation on behalf of 75bc8650bf2341bf9ded2f24a62fd9b6 for: {'subnet': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:50:32.402757 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Notify callbacks [] for subnet, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:32.871450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.objects.ports [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103981) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 26 14:50:32.871811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:32.876058 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:32.952705 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Pushing event updated for resources: {'Subnet': ['ID=1d967d29-3b15-482f-9d0a-3caaa5236973,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:32.954922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:50:32.955269 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Network hostable DHCP agents. Network: 0090f6f3-94b8-4606-8d1e-abbe36685c7a, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103981) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:50:32.961097 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:33.074419 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103981) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:50:33.154470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 0090f6f3-94b8-4606-8d1e-abbe36685c7a) {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:33.159032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:33.159637 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:33.165694 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-db3e36bc-8a7b-4cec-a18d-f5ed5c2e4487 None None] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:50:33.292369 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.9984715
May 26 14:50:33.366799 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4798f1aa-4e5f-4da7-bb4e-c150ec1bda05 None None] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:50:34.960834 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:35.114413 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:50:35.120150 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:35.120523 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:35.240710 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:35.273361 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,segment=NetworkSegment(0fcc3b29-34ee-402f-bfeb-920c16ed1d01),segment_id=0fcc3b29-34ee-402f-bfeb-920c16ed1d01)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:50:35.286631 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:50:35.337507 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:35.339740 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-45efbb90-1912-4e91-845c-cf05ebb48ab5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:35.408615 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:35.412008 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:35.536415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 52508) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:35.790164 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-47e52125-86f9-4c8d-890f-bbaa49844d3b admin admin] 10.222.0.81 "GET /v2.0/routers/9cdbba0a-b830-43f6-8668-c571e7e91233 HTTP/1.1" status: 200  len: 710 time: 0.2526176
May 26 14:50:35.914560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e62c81d-455b-4a5c-a4a2-e2b59c941258 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:50:35.915900 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9e62c81d-455b-4a5c-a4a2-e2b59c941258 admin admin] 10.222.0.81 "GET /v2.0/networks/0090f6f3-94b8-4606-8d1e-abbe36685c7a HTTP/1.1" status: 200  len: 886 time: 0.1243622
May 26 14:50:35.924499 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:50:36.392579 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:36.820082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:36.877170 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:36.944283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:37.012996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:37.013359 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:37.019459 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Allocated IP 172.27.2.197 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/9c1a9eda-4a0e-4e2c-b7cf-d408b131c925) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:50:37.170133 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:37.278938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:37.282814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:37.349777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:50:37.352778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:50:37.357135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:50:37.421068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Pushing event updated for resources: {'Port': ['ID=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:37.470918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:37.797189 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:38.163114 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:38.167067 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3927607', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3927552', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3921291'] for router, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:38.366024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Router 9cdbba0a-b830-43f6-8668-c571e7e91233 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:50:38.541747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:50:38.550642 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Sync routers for ids ['9cdbba0a-b830-43f6-8668-c571e7e91233'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:50:38.551054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:38.551929 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] 10.222.0.81 "PUT /v2.0/routers/9cdbba0a-b830-43f6-8668-c571e7e91233 HTTP/1.1" status: 200  len: 890 time: 2.6306167
May 26 14:50:38.560155 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Routers {'9cdbba0a-b830-43f6-8668-c571e7e91233'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:50:38.560833 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac442d6d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9cdbba0a-b830-43f6-8668-c571e7e91233'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:38.760674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Set router 9cdbba0a-b830-43f6-8668-c571e7e91233 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:50:39.114914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac442d6d0>, [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197'}], 'enable_snat': True}, 'gw_port_id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:37Z', 'revision_number': 4, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port': {'id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:21:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:36Z', 'updated_at': '2021-05-26T14:50:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:35Z', 'revision_number': 5, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:39.120440 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Checking router: 9cdbba0a-b830-43f6-8668-c571e7e91233 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:50:39.120793 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Updating router 9cdbba0a-b830-43f6-8668-c571e7e91233 port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:50:39.192299 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.526063 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.538166 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Transition to ACTIVE for port object 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:50:39.621512 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.625614 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:39.702483 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Attempting to bind port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:50:39.702844 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Attempting to bind port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:50:39.703201 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Attempting to bind port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:50:39.705086 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Pushing event updated for resources: {'Port': ['ID=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:39.708559 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:39.711193 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 50, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:50:39.711587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:50:39.711936 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.712308 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:50:39.712767 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Bound port: 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:50:39.713128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.784594 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] For port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:50:39.786976 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] For port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:50:39.861944 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:39.866009 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:39.943796 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Routers {'9cdbba0a-b830-43f6-8668-c571e7e91233'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:50:39.944401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac442d6d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:50:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9cdbba0a-b830-43f6-8668-c571e7e91233'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:39.998054 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Pushing event updated for resources: {'Port': ['ID=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:40.010326 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:40.127831 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] Set router 9cdbba0a-b830-43f6-8668-c571e7e91233 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:50:40.447298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac442d6d0>, [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197'}], 'enable_snat': True}, 'gw_port_id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:37Z', 'revision_number': 4, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port': {'id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:21:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:36Z', 'updated_at': '2021-05-26T14:50:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:35Z', 'revision_number': 5, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:50:40.451311 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41c0c007-4aa5-4b81-8020-0081289ced7f None None] The sync data for ids ['9cdbba0a-b830-43f6-8668-c571e7e91233'] in dv-cinder-784140-4-iscsi is: [{'id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'name': 'router1', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197'}], 'enable_snat': True}, 'gw_port_id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:50:18Z', 'updated_at': '2021-05-26T14:50:37Z', 'revision_number': 4, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'gw_port': {'id': '9c1a9eda-4a0e-4e2c-b7cf-d408b131c925', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:21:8f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.197', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:36Z', 'updated_at': '2021-05-26T14:50:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9', 'name': '', 'network_id': '5e578773-4e76-4ff9-89c5-710d7a80ed8b', 'tenant_id': 'b54e97f29d114770becbf544bc62ec8c', 'mac_address': 'fa:16:3e:63:24:98', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9cdbba0a-b830-43f6-8668-c571e7e91233', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:50:28Z', 'updated_at': '2021-05-26T14:50:35Z', 'revision_number': 5, 'project_id': 'b54e97f29d114770becbf544bc62ec8c', 'subnets': [{'id': '23ab9d0a-3872-4e31-8743-9a3fade91b8e', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '1194c304-cf44-4c6b-9a4f-2169b160b8e6'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:50:40.923591 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 52518) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:50:40.976731 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:41.053628 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-df82f533-f5f6-4a90-b034-be2ea403af4c admin admin] 10.222.0.81 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1281683
May 26 14:50:41.125909 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:50:41.131336 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:41.132045 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:41.262709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:41.281256 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:50:41.337377 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:41.339990 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:50:41.407525 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=9c1a9eda-4a0e-4e2c-b7cf-d408b131c925,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:50:41.411359 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:50:42.967232 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:50:43.039732 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 9c1a9eda-4a0e-4e2c-b7cf-d408b131c925 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:50:43.040163 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:50.474361 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-acdc3ae8-0cc4-4d3f-9219-4a94931eeddc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:53.080368 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:53.143059 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5e424de2-64d2-44ca-b14d-da5f23328841 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:53.975416 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:50:55.552395 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:12.289309 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:51:20.502769 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6a12fe4a-b277-41f3-9e57-c1f43313a579 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:23.205621 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:23.239113 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5c4e2cc2-877c-4717-b1d0-d7ca3d3abb80 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:24.031973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:25.542871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:49.296808 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:51:50.488807 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-ddedf7eb-f2b2-4360-8ca5-3c924b8e56f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:53.068356 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:53.128434 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-69873b5b-c846-4aaa-8258-007c9b9cddc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:54.031618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:51:55.565075 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:17.437750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53088) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:17.505164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.pecan_wsgi.hooks.translation [None req-6f83cae0-98f6-46d9-a9ab-3ba536f3ed08 admin admin] GET failed (client error): The resource could not be found.
May 26 14:52:17.506456 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6f83cae0-98f6-46d9-a9ab-3ba536f3ed08 admin admin] 10.222.0.81 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0677488
May 26 14:52:17.636623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8ffee424-35aa-499f-ab48-90b36fd8082f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:17.638164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-8ffee424-35aa-499f-ab48-90b36fd8082f admin admin] 10.222.0.81 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 873 time: 0.1278362
May 26 14:52:19.746415 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53098) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:19.860427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23f10a47-411d-425a-97c7-2e8cabbe155c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:19.860975 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-23f10a47-411d-425a-97c7-2e8cabbe155c admin admin] Synchronizing usage tracker for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:subnet {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:52:20.038964 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-23f10a47-411d-425a-97c7-2e8cabbe155c admin admin] Unset dirty status for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:subnet {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:52:20.040185 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-23f10a47-411d-425a-97c7-2e8cabbe155c admin admin] 10.222.0.81 "GET /v2.0/subnets/23ab9d0a-3872-4e31-8743-9a3fade91b8e HTTP/1.1" status: 200  len: 849 time: 0.2927935
May 26 14:52:20.049412 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:52:20.167222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Notify callbacks [] for subnet, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:20.404796 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8781805455261'] for subnet, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:20.409730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-525432b7-f5f7-416c-b77c-10dc02dc68cf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:52:20.447539 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:20.448380 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:20.449390 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] 10.222.0.81 "PUT /v2.0/subnets/23ab9d0a-3872-4e31-8743-9a3fade91b8e HTTP/1.1" status: 200  len: 868 time: 0.4038501
May 26 14:52:20.452423 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-449c07fd-609a-42d8-80f3-2ea327776ed7 None None] Network 5e578773-4e76-4ff9-89c5-710d7a80ed8b requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:52:20.477608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Pushing event updated for resources: {'Subnet': ['ID=23ab9d0a-3872-4e31-8743-9a3fade91b8e,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:52:20.485275 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.485678 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.486225 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.486561 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.486888 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.487215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.487539 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.487877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.488759 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.489134 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.489679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.489801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:52:20.493342 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:52:20.526837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-fae1b116-21ff-4ef4-a7f0-d1b79ccce13c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:20.912779 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-2e91e417-6594-4242-9e4f-f8766c170722 None None] Provisioning complete for port 7354a3f8-a41e-413e-a9e3-0af325ac3f23 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:52:20.913156 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2e91e417-6594-4242-9e4f-f8766c170722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:21.038044 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-2e91e417-6594-4242-9e4f-f8766c170722 None None] Provisioning complete for port 6b94e04d-45d4-45d7-9b03-9ed65fa6d8c9 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:52:21.038309 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2e91e417-6594-4242-9e4f-f8766c170722 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:22.560552 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53108) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:22.733316 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91647a95-4390-4135-9a63-f1ebea6a619a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:22.733824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-91647a95-4390-4135-9a63-f1ebea6a619a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:22.735338 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-91647a95-4390-4135-9a63-f1ebea6a619a admin admin] 10.222.0.81 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1550 time: 0.1737971
May 26 14:52:23.065982 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:23.153338 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c15eeb1a-e103-41a6-9ba0-5d32432c615f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:23.996413 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:24.827587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53118) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:25.001832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06ef0a2c-eced-4eb5-83e0-c88638df3ceb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:25.002306 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06ef0a2c-eced-4eb5-83e0-c88638df3ceb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:25.004033 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-06ef0a2c-eced-4eb5-83e0-c88638df3ceb admin admin] 10.222.0.81 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1550 time: 0.1753061
May 26 14:52:25.562733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:26.288789 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:52:27.168767 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53128) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:27.359609 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e8b6c102-0c57-4e0d-bb9e-98216f86b1d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:27.360902 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e8b6c102-0c57-4e0d-bb9e-98216f86b1d8 admin admin] 10.222.0.81 "GET /v2.0/networks/0090f6f3-94b8-4606-8d1e-abbe36685c7a HTTP/1.1" status: 200  len: 886 time: 0.1928904
May 26 14:52:29.546938 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53138) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:29.725454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c733281-80f3-47da-9240-d14a745e6c2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:29.726768 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6c733281-80f3-47da-9240-d14a745e6c2a admin admin] 10.222.0.81 "GET /v2.0/networks/5e578773-4e76-4ff9-89c5-710d7a80ed8b HTTP/1.1" status: 200  len: 870 time: 0.1788983
May 26 14:52:31.843499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53148) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:31.967009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-293759ba-6418-4384-878b-09dfa972403c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:31.967470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-293759ba-6418-4384-878b-09dfa972403c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:31.968997 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-293759ba-6418-4384-878b-09dfa972403c admin admin] 10.222.0.81 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1245675
May 26 14:52:34.075198 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53158) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:34.181759 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e40a3cde-d939-4772-b0b6-b311bbaf5650 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:34.182217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e40a3cde-d939-4772-b0b6-b311bbaf5650 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:34.183695 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e40a3cde-d939-4772-b0b6-b311bbaf5650 admin admin] 10.222.0.81 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1075571
May 26 14:52:36.277724 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53168) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:36.377106 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6dcd9cb3-488f-4466-b51e-3cd52a371bf9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:36.378983 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6dcd9cb3-488f-4466-b51e-3cd52a371bf9 admin admin] 10.222.0.81 "GET /v2.0/subnets/1d967d29-3b15-482f-9d0a-3caaa5236973 HTTP/1.1" status: 200  len: 816 time: 0.0997846
May 26 14:52:38.480886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53178) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:52:38.591784 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-87207208-3f29-4aac-8c4a-468c7702d6ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:52:38.593116 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-87207208-3f29-4aac-8c4a-468c7702d6ef admin admin] 10.222.0.81 "GET /v2.0/subnets/23ab9d0a-3872-4e31-8743-9a3fade91b8e HTTP/1.1" status: 200  len: 868 time: 0.1112967
May 26 14:52:50.519166 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bce028d-a34a-405a-8b5a-4917b69f6d4c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:53.071057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:53.143052 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2e90a16b-ea72-40f3-a3a3-6a31ec3fa752 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:53.993109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:52:55.589639 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:01.750608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53224) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:53:01.801454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [None req-16e2f3d6-bf9e-4b45-ad2b-6f6dea7883e0 admin admin] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103981) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:53:01.802466 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-16e2f3d6-bf9e-4b45-ad2b-6f6dea7883e0 admin admin] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0509241
May 26 14:53:03.288405 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:53:04.011553 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53234) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:53:04.077902 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.pecan_wsgi.hooks.translation [None req-5def7742-1e0d-4ab1-9e16-e578a632f4ac admin admin] GET failed (client error): The resource could not be found.
May 26 14:53:04.079155 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5def7742-1e0d-4ab1-9e16-e578a632f4ac admin admin] 10.222.0.81 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0666187
May 26 14:53:04.202653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-55b26a23-9c7f-4b0f-b4f2-2efc37f10d35 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:53:04.204021 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-55b26a23-9c7f-4b0f-b4f2-2efc37f10d35 admin admin] 10.222.0.81 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1210034
May 26 14:53:06.345992 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53244) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:53:06.393223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:53:06.397688 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:53:06.407404 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:53:06.495900 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Made reservation on behalf of 75bc8650bf2341bf9ded2f24a62fd9b6 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:53:06.498236 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:06.623101 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING neutron.services.revisions.revision_plugin [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7fcac58e44f0] {project_id='75bc8650bf2341bf9ded2f24a62fd9b6', id='44dd6c70-1f99-4c22-bc32-c248bfc0e6b6', target_tenant='*', action='access_as_shared', object_id='acf7e4b9-87b3-4e48-b7f3-29816212960d'}> to bump revision.
May 26 14:53:06.635262 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1249}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:53:06.643934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:06.645244 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Added segment 1f795401-233e-4b1b-a86a-8738ee2a8006 of type vlan for network acf7e4b9-87b3-4e48-b7f3-29816212960d
May 26 14:53:06.669206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:06.775462 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:06.776765 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:53:06.777331 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:06.780441 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:53:06.875641 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Pushing event updated for resources: {'Network': ['ID=acf7e4b9-87b3-4e48-b7f3-29816212960d,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:53:06.878486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:53:06.885522 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network acf7e4b9-87b3-4e48-b7f3-29816212960d details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:53:06.959329 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7e98ba8d-694c-425c-855b-1ecbba140647 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 848 time: 0.6119945
May 26 14:53:09.083927 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53254) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:53:09.151907 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.pecan_wsgi.hooks.translation [None req-f676b1fb-5a33-444a-aa7e-92b6f600664b admin admin] GET failed (client error): The resource could not be found.
May 26 14:53:09.153154 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f676b1fb-5a33-444a-aa7e-92b6f600664b admin admin] 10.222.0.81 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0682631
May 26 14:53:09.257911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abbef709-c40a-44c7-8176-49657885dee9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:53:09.259249 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-abbef709-c40a-44c7-8176-49657885dee9 admin admin] 10.222.0.81 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 827 time: 0.1019678
May 26 14:53:09.268582 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Request body: {'subnet': {'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d', 'description': 'shared-subnet', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:53:09.273445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:53:09.283073 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:53:09.364149 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Made reservation on behalf of 75bc8650bf2341bf9ded2f24a62fd9b6 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:53:09.366462 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:09.792697 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:09.796998 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-000ed328-e466-4c52-ba7d-22cd7d9fc91e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:53:09.864772 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Pushing event updated for resources: {'Subnet': ['ID=11ad92d2-48d9-4f94-96d6-0af955f646ce,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:53:09.873895 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.874248 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.874576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.874893 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.875206 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.875536 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.875852 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.876164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.876488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.876801 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.877132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.877467 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:09.881732 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:53:09.882531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Checking segment: {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:53:09.882880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Network hostable DHCP agents. Network: acf7e4b9-87b3-4e48-b7f3-29816212960d, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:53:09.952350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Network acf7e4b9-87b3-4e48-b7f3-29816212960d is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:53:10.030151 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, acf7e4b9-87b3-4e48-b7f3-29816212960d) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:53:10.036242 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:53:10.039225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:10.042872 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d89e741c-ac35-45d7-af72-3b5a3d6f14e0 None None] Network acf7e4b9-87b3-4e48-b7f3-29816212960d requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:53:10.139689 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.8744342
May 26 14:53:10.260798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-acf7e4b9-87b3-4e48-b7f3-29816212960d', 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d', 'tenant_id': '75bc8650bf2341bf9ded2f24a62fd9b6', 'fixed_ips': [{'subnet_id': '11ad92d2-48d9-4f94-96d6-0af955f646ce'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 14:53:10.261739 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:10.422970 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Allocated IP 192.168.233.2 (acf7e4b9-87b3-4e48-b7f3-29816212960d/11ad92d2-48d9-4f94-96d6-0af955f646ce/70e8602f-bafb-473f-93d2-8496d4073b1e) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:53:10.656096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:10.666644 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Transition to ACTIVE for port object 70e8602f-bafb-473f-93d2-8496d4073b1e will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:53:10.685026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Transition to ACTIVE for port object 70e8602f-bafb-473f-93d2-8496d4073b1e will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:53:10.770732 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:10.775273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:53:10.837654 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Network acf7e4b9-87b3-4e48-b7f3-29816212960d is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:53:10.840558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:53:10.844192 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:53:10.850006 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Pushing event updated for resources: {'Port': ['ID=70e8602f-bafb-473f-93d2-8496d4073b1e,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:53:10.882029 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.882390 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.882734 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.883058 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.883379 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.883707 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.884026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.884343 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.884682 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.884998 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.885329 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.885743 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:53:10.893307 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:53:10.950878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Attempting to bind port 70e8602f-bafb-473f-93d2-8496d4073b1e on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:53:10.951161 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Attempting to bind port 70e8602f-bafb-473f-93d2-8496d4073b1e by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:53:10.951519 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Attempting to bind port 70e8602f-bafb-473f-93d2-8496d4073b1e on network acf7e4b9-87b3-4e48-b7f3-29816212960d {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:53:10.957096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 52, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:53:10.957460 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Checking segment: {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:53:10.957938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:10.958325 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Bound using segment: {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:53:10.958789 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Bound port: 70e8602f-bafb-473f-93d2-8496d4073b1e, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:53:10.959156 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:11.047243 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] For port 70e8602f-bafb-473f-93d2-8496d4073b1e, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:53:11.051073 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] For port 70e8602f-bafb-473f-93d2-8496d4073b1e, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=70e8602f-bafb-473f-93d2-8496d4073b1e,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:53:11.114143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:11.118135 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:53:11.194246 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Pushing event updated for resources: {'Port': ['ID=70e8602f-bafb-473f-93d2-8496d4073b1e,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:53:11.197246 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:53:11.982237 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0da285b0-f2cf-4115-86b8-70c4e7b84dae None None] Network acf7e4b9-87b3-4e48-b7f3-29816212960d requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:53:12.142978 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-291385e5-3e34-45de-bb3e-63b31168a9db None None] Provisioning for port 70e8602f-bafb-473f-93d2-8496d4073b1e completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:53:13.082829 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 70e8602f-bafb-473f-93d2-8496d4073b1e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:53:13.198437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 70e8602f-bafb-473f-93d2-8496d4073b1e completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:53:13.204528 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 70e8602f-bafb-473f-93d2-8496d4073b1e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:53:13.204960 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:13.324021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:13.355055 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 70e8602f-bafb-473f-93d2-8496d4073b1e, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=70e8602f-bafb-473f-93d2-8496d4073b1e,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:53:13.435674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:13.437804 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1ba6d593-4372-46cb-9649-6c4fbf049f24 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:53:13.502757 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=70e8602f-bafb-473f-93d2-8496d4073b1e,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:53:13.505705 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:53:15.060228 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 70e8602f-bafb-473f-93d2-8496d4073b1e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:53:15.139999 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 70e8602f-bafb-473f-93d2-8496d4073b1e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:53:15.140362 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:20.484151 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-345ef402-4032-411b-ba20-7e87995a1514 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:23.065084 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:23.155508 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6c71fb43-f5ac-494f-80a9-4c2da5ee3c99 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:24.007025 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:25.552685 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:40.288586 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:53:50.529601 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e0eb3bca-05cc-4140-8410-37f9f13ed694 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:53.103890 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:53.132275 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a242bea7-ef39-45ff-bae1-701b8d0cdb96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:53.992551 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:53:55.581553 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:17.288123 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:54:20.500833 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-035848ed-70a4-4c78-8a72-d51638cb9429 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:23.086445 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:23.166885 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-62136f56-8c08-4216-8e5c-a539f03bd6c6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:24.000672 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:25.566374 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:26.812409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53304) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:54:26.819111 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [None req-3ae764af-6090-45ab-80e0-64eb30469184 tempest-verify_tempest_config-1379666607 tempest-verify_tempest_config-1379666607-project] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:54:26.820062 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-3ae764af-6090-45ab-80e0-64eb30469184 tempest-verify_tempest_config-1379666607 tempest-verify_tempest_config-1379666607-project] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0067086
May 26 14:54:27.410706 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53322) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:54:27.524209 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:27.538818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:54:27.542582 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Usage tracker for resource:security_group_rule and tenant:794c20a4897d4c148935891a28f27691 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:54:27.545307 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:54:27.551070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:54:27.630326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:27.720152 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:27.731835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:54:27.770305 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=794c20a4897d4c148935891a28f27691&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3585827
May 26 14:54:27.771811 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aed95cbf-35ab-4385-ada3-c4d5239ba689,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:54:27.774078 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53328) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:54:27.778692 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.779051 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.779381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.779700 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.780019 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.780607 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.780934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.781260 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.781599 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.781910 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.782222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.782641 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:27.786704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:54:27.835885 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:27.860191 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:28.057755 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:28.061653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:54:28.073156 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aed95cbf-35ab-4385-ada3-c4d5239ba689,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:54:28.082459 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.082821 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.083160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.083491 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.083816 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.084139 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.084575 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.084902 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.085227 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.085566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.085885 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.086200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:54:28.089639 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:54:28.090537 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:28.091690 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/aed95cbf-35ab-4385-ada3-c4d5239ba689 HTTP/1.1" status: 204  len: 168 time: 0.3165317
May 26 14:54:50.535187 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-948dd601-d2ff-426e-878c-4be605acf6f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:53.072143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:53.143008 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-d2d05afc-c8b5-4c11-a4ef-64fdfb6a5056 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:54.005882 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:54:54.288129 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:54:55.580384 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:20.551925 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-af3146c1-62e2-44f9-a10b-09f0842fe9ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:23.067846 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:23.136912 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-3179efc5-0dc4-4156-a9de-1ea8f80178fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:24.005504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:25.571265 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:31.288226 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 5 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:55:50.507860 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-ce3bd8d2-a966-44c0-b95f-0d0204ffdf12 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:53.102434 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:53.131118 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f6567ddb-e1d9-42f9-bd2d-d2d762237815 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:54.008716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:55.563047 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:55:57.530788 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639'] for agent, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:01.070286 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53380) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:56:01.180523 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7356b236-f309-48b2-860a-928ed26c2623 admin admin] 10.222.0.81 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1091623
May 26 14:56:03.302186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53390) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:56:03.357640 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-68cda441-5506-42a7-bae1-9b005e595341 admin admin] 10.222.0.81 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0543349
May 26 14:56:08.287636 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:56:20.496124 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c6937441-b964-4231-9cfc-cae7846a7f38 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:23.093774 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:23.173804 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-d6f84d16-e42d-40f9-9b90-557fcde06939 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:24.015734 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:25.581562 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:27.551119 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:45.287121 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:56:50.495927 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6057e083-61d4-4a29-ac1a-5688f6683b54 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:53.088778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:53.168313 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-43bab36c-6558-4695-b54c-e38977489b6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:54.028207 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:55.608714 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:56:57.511226 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:20.495615 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e6ceccc7-b214-467c-9e5b-032308a0fe34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:22.287415 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:57:23.099700 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:23.169420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-801bd0e5-b537-479a-9bec-6f9c28fb151f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:24.032698 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:25.609704 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:27.552709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:29.743344 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53614) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:29.777881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53620) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:29.871984 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53628) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:29.900561 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53634) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:30.145897 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-330955373-network', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:30.152341 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.156809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Usage tracker for resource:network and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.163228 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-950198238-network', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:30.166231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.172247 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.177017 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Usage tracker for resource:network and tenant:0ad2ab2705ca479ab4aaafe7c80de162 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.180619 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.188474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.190620 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.195963 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-network', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:30.212586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.215279 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Usage tracker for resource:network and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.218541 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.228002 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-69788076-network', 'tenant_id': 'e0f665681e524725b9abb121531f47a5'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:30.229700 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.233165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.241112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Usage tracker for resource:network and tenant:e0f665681e524725b9abb121531f47a5 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.241112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.247208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.301354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Made reservation on behalf of 81e8cac36a174b2eb5a6e53fdf25b4cc for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:30.305293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.320505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.327859 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Made reservation on behalf of e0f665681e524725b9abb121531f47a5 for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:30.332548 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.332673 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Made reservation on behalf of 0ad2ab2705ca479ab4aaafe7c80de162 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:30.334399 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.343622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Made reservation on behalf of 7555f6895a2a405685d8ccfe81fe5a74 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:30.344703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.346404 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.361839 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.372084 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.374628 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Usage tracker for resource:security_group_rule and tenant:e0f665681e524725b9abb121531f47a5 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.377687 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.384553 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.386134 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.389000 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.403220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.409293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.415144 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.423310 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.426463 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:30.431257 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.438081 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.447202 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Usage tracker for resource:security_group_rule and tenant:0ad2ab2705ca479ab4aaafe7c80de162 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:30.455043 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:30.463666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.472945 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:30.484315 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.570046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.590105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1228}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:30.618398 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.621364 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Added segment fc5f4185-4145-44ee-8d30-2fdc2c29ad21 of type vlan for network fc8154d0-713e-4031-a1fb-bb0dd6440711
May 26 14:57:30.622669 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:30.626424 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.643229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.697915 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.700654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:30.704060 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.712781 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-694435e0-32fb-401e-b27e-27e5083a9032 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:30.717950 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.718294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.718684 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.719188 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.719676 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.720321 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.720810 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.721311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.721837 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.722355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.722852 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.723338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Tracked resource versions report:
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]: pushed versions:
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]: {   'AddressGroup': {'1.2'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'ConntrackHelper': {'1.0'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Log': {'1.0'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Network': {'1.1'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Port': {'1.7'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'PortForwarding': {'1.2'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'QosPolicy': {'1.8'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SecurityGroup': {'1.4'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SecurityGroupRule': {'1.2'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'SubPort': {'1.0'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Subnet': {'1.1'},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     'Trunk': {'1.1'}}
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]: consumer versions:
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     HyperV agent@hv-cinder-78414: {},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'ConntrackHelper': '1.0',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Log': '1.0',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Network': '1.1',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Port': '1.7',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'PortForwarding': '1.2',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'QosPolicy': '1.8',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SecurityGroup': '1.4',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SecurityGroupRule': '1.2',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'SubPort': '1.0',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Subnet': '1.1',
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:                                                      'Trunk': '1.1'}}
May 26 14:57:30.724992 dv-cinder-784140-4-iscsi neutron-server[103982]:  {{(pid=103982) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:57:30.727889 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.732395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:30.756059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56d52ae5-5589-46d2-aea6-10a220f07bf7,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:30.766781 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.767135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.768109 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.768487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.768809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.769561 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.769925 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.770239 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.770669 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.770980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.771288 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.772057 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Tracked resource versions report:
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]: pushed versions:
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]: {   'AddressGroup': {'1.2'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'ConntrackHelper': {'1.0'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Log': {'1.0'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Network': {'1.1'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Port': {'1.7'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'PortForwarding': {'1.2'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'QosPolicy': {'1.8'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SecurityGroup': {'1.4'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SecurityGroupRule': {'1.2'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'SubPort': {'1.0'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Subnet': {'1.1'},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     'Trunk': {'1.1'}}
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]: consumer versions:
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     HyperV agent@hv-cinder-78414: {},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'ConntrackHelper': '1.0',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Log': '1.0',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Network': '1.1',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Port': '1.7',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'PortForwarding': '1.2',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'QosPolicy': '1.8',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SecurityGroup': '1.4',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SecurityGroupRule': '1.2',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'SubPort': '1.0',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Subnet': '1.1',
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:                                                      'Trunk': '1.1'}}
May 26 14:57:30.773268 dv-cinder-784140-4-iscsi neutron-server[103981]:  {{(pid=103981) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:57:30.779859 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.780753 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:30.796905 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1213}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:30.807035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.807419 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Added segment ea823f2c-1ccd-4b9d-bad1-23568a81a1e8 of type vlan for network bc70d705-69d9-4bd7-ad11-798aa6a60676
May 26 14:57:30.839144 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.867716 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1230}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:30.869661 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:30.881216 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.893030 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.893366 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Added segment 5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6 of type vlan for network 9a6b2b45-d448-425b-9716-75ffabad6539
May 26 14:57:30.895985 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.906567 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:30.906567 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.906567 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8253963d-6248-4153-b5e1-3f3dc434f3fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:30.938515 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1224}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:30.943903 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c89e580d-d6eb-4c8d-8572-6da7628ab71c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:30.952092 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.957512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:30.960542 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:30.961486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.069s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:30.977744 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:30.978332 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.002095 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.002443 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Added segment e16500c6-bc20-4512-be7a-ff27e5886c30 of type vlan for network c010dc4d-023b-4979-a482-d3b3e0924e91
May 26 14:57:31.040293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ca23e97-1854-408b-b83c-26e0752c75ef,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:31.048811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:31.059358 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-97404d60-0c05-433e-8dd4-d321fc4e9754 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.073s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:31.091198 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.172018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.192596 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:31.193719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.239077 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Pushing event updated for resources: {'Network': ['ID=bc70d705-69d9-4bd7-ad11-798aa6a60676,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:31.246410 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Pushing event updated for resources: {'Network': ['ID=fc8154d0-713e-4031-a1fb-bb0dd6440711,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:31.252538 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:31.256004 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.195s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:31.261483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.357s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:31.264675 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.063s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:31.294072 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.5495648
May 26 14:57:31.298056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53682) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:31.306662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Request body: {'subnet': {'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-subnet', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:31.313011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:31.321167 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.4187481
May 26 14:57:31.322518 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53686) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:31.328783 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Usage tracker for resource:subnet and tenant:0ad2ab2705ca479ab4aaafe7c80de162 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:31.342464 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Request body: {'subnet': {'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-69788076-subnet', 'tenant_id': 'e0f665681e524725b9abb121531f47a5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:31.350129 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:31.355430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:31.366045 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:31.371039 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Usage tracker for resource:subnet and tenant:e0f665681e524725b9abb121531f47a5 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:31.375646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:31.398811 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network fc8154d0-713e-4031-a1fb-bb0dd6440711 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:31.399795 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:31.408932 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.6279805
May 26 14:57:31.409195 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53694) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:31.434508 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Request body: {'subnet': {'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-330955373-subnet', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:31.439934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.443289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Pushing event updated for resources: {'Network': ['ID=9a6b2b45-d448-425b-9716-75ffabad6539,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:31.446209 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:31.448762 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.449958 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:31.457456 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:31.457721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Usage tracker for resource:subnet and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:31.457992 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:31.464346 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:31.483929 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:31.495870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Made reservation on behalf of 0ad2ab2705ca479ab4aaafe7c80de162 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:31.501744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.503249 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 9a6b2b45-d448-425b-9716-75ffabad6539 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:31.565757 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Pushing event updated for resources: {'Network': ['ID=c010dc4d-023b-4979-a482-d3b3e0924e91,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:31.568379 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:31.595139 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network c010dc4d-023b-4979-a482-d3b3e0924e91 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:31.609142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Made reservation on behalf of e0f665681e524725b9abb121531f47a5 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:31.612488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.625821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Made reservation on behalf of 81e8cac36a174b2eb5a6e53fdf25b4cc for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:31.628444 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:31.649962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53702) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:31.655348 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 891 time: 1.7763524
May 26 14:57:31.668771 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Request body: {'subnet': {'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-subnet', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:31.815465 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:31.830214 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Usage tracker for resource:subnet and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:31.840164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:31.861319 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:32.048339 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Made reservation on behalf of 7555f6895a2a405685d8ccfe81fe5a74 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:32.051201 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:32.921848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.016363 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:33.100204 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.126476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.175829 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Pushing event updated for resources: {'Subnet': ['ID=71664cfa-bf05-4585-89e0-ac077a670be9,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:33.177987 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Checking segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:33.178331 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Network hostable DHCP agents. Network: bc70d705-69d9-4bd7-ad11-798aa6a60676, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:57:33.181224 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:33.185582 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d466517f-0592-45d7-a2c0-45e261f3680f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.059s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:33.287002 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Checking segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:33.287348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Network hostable DHCP agents. Network: 9a6b2b45-d448-425b-9716-75ffabad6539, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:57:33.302258 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Checking segment: {'id': 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1228, 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:33.302606 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Network hostable DHCP agents. Network: fc8154d0-713e-4031-a1fb-bb0dd6440711, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:57:33.336663 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Pushing event updated for resources: {'Subnet': ['ID=455a1c06-d094-4995-9b7a-561be9ec484c,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:33.393911 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53764) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:33.413841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:57:33.427872 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.435988 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fff245df-826f-4da5-acad-7148fe1aea38,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:33.438846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:33.442846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.297s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:33.494388 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Network fc8154d0-713e-4031-a1fb-bb0dd6440711 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:57:33.496318 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:57:33.520125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.526914 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=09a19960-7788-4d46-a08e-92c63f201983,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:33.532258 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:33.532664 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.097s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:33.532932 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:33.535487 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Checking segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:33.535961 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Network hostable DHCP agents. Network: c010dc4d-023b-4979-a482-d3b3e0924e91, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:57:33.540639 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:33.547273 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Usage tracker for resource:security_group_rule and tenant:032e764aadcd42018293403e2d7b76a6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:33.549051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:33.555996 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:33.559434 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, bc70d705-69d9-4bd7-ad11-798aa6a60676) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:33.563626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, fc8154d0-713e-4031-a1fb-bb0dd6440711) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:33.571270 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-55ec3aba-4f67-472b-92a5-c66348de5fe6 None None] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:33.577714 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:33.578394 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.582976 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 9a6b2b45-d448-425b-9716-75ffabad6539) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:33.596626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:33.597335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.602970 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6740c503-409d-47c5-b8a6-a50344bb7f21 None None] Network 9a6b2b45-d448-425b-9716-75ffabad6539 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:33.627942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:33.628814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.636498 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a7088f6e-b7e8-4800-be34-e7828ce22809 None None] Network fc8154d0-713e-4031-a1fb-bb0dd6440711 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:33.648244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:57:33.656080 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, c010dc4d-023b-4979-a482-d3b3e0924e91) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:33.662116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:33.662770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.672039 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.703487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53774) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:33.710527 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 855 time: 2.4089262
May 26 14:57:33.711469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53780) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:33.718177 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-550eb93f-d498-47be-a659-e09963dcfacd None None] Network c010dc4d-023b-4979-a482-d3b3e0924e91 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:33.718849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:33.721366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:33.726743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Usage tracker for resource:router and tenant:0ad2ab2705ca479ab4aaafe7c80de162 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:33.729993 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:33.735590 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.736641 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:33.743335 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9f1a4d47-f8da-45a7-bf7f-030975c832bb admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 2.3310738
May 26 14:57:33.748787 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53786) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:33.749516 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:33.750839 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 2.4253030
May 26 14:57:33.770350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:33.794579 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:33.795668 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-52a886a7-8371-4de1-b798-04f0ff6125d3 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 853 time: 2.1406000
May 26 14:57:33.798337 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53792) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:33.806471 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Usage tracker for resource:router and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:33.808574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:33.810485 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:33.814789 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Synchronizing usage tracker for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:33.815577 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:33.817717 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4070bd66-2fe2-4fd3-a125-7756bb3c2539,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:33.822637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.824525 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.832263 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:33.832612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Usage tracker for resource:router and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:33.836151 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:33.842846 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:33.844458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:33.855686 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.865197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.877926 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:33.882869 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Usage tracker for resource:security_group_rule and tenant:e7c2b22e768249cf87b9ed31faf2f730 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:33.886089 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:33.892713 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:33.981137 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.982965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.984147 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:33.985803 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.005660 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.022581 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.026697 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Unset dirty status for tenant:75bc8650bf2341bf9ded2f24a62fd9b6 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:57:34.028663 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=032e764aadcd42018293403e2d7b76a6&name=default HTTP/1.1" status: 200  len: 2975 time: 0.6319621
May 26 14:57:34.031264 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53804) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:34.070798 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.192050 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.270673 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1331ea76-f563-4cd5-9b7a-39364e148f5e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:34.356087 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.387727 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2d9ab3a-1162-430a-bc1c-097555ddae36,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:34.406690 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e7c2b22e768249cf87b9ed31faf2f730&name=default HTTP/1.1" status: 200  len: 2975 time: 0.7020886
May 26 14:57:34.412168 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:34.412735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53824) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:34.614305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.676154 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c3d298b-d92f-46d4-b8a8-7c01a5d04a91 None None] Network fc8154d0-713e-4031-a1fb-bb0dd6440711 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:34.685754 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53840) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:34.694784 dv-cinder-784140-4-iscsi neutron-server[103981]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 26 14:57:34.723645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.752663 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.839640 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8af53ae0-42a1-4595-a83b-877cb6968477 None None] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:34.845647 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.856217 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.943507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:34.990733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-7588e363-285a-45ae-8f7d-a084dc895dbf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:34.994087 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-7588e363-285a-45ae-8f7d-a084dc895dbf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/networks?id=fc8154d0-713e-4031-a1fb-bb0dd6440711 HTTP/1.1" status: 200  len: 810 time: 0.3068612
May 26 14:57:35.023007 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-53330e97-00ed-4d91-9aa9-9de98351edc1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/quotas/e0f665681e524725b9abb121531f47a5 HTTP/1.1" status: 200  len: 375 time: 0.0248010
May 26 14:57:35.028462 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-9a6b2b45-d448-425b-9716-75ffabad6539', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 14:57:35.029600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.062527 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.072121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-646d1e43-6a53-4743-b9f9-d889ded98ed3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:35.092743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4070bd66-2fe2-4fd3-a125-7756bb3c2539,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:35.098586 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-8c7e8c55-6ce0-47de-919f-e4cfc323c650 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=e0f665681e524725b9abb121531f47a5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0549772
May 26 14:57:35.142526 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.153473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:35.215247 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.216484 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4070bd66-2fe2-4fd3-a125-7756bb3c2539 HTTP/1.1" status: 204  len: 168 time: 1.1843131
May 26 14:57:35.340577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:35.406470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2d9ab3a-1162-430a-bc1c-097555ddae36,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:35.410726 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:35.418968 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-c010dc4d-023b-4979-a482-d3b3e0924e91', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 14:57:35.421212 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.430371 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.434118 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f2d9ab3a-1162-430a-bc1c-097555ddae36 HTTP/1.1" status: 204  len: 168 time: 1.0152776
May 26 14:57:35.439877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.473941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.647918 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-20e348d4-bfae-4dce-84b9-3aa6551b6454 service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103981) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:57:35.655287 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-20e348d4-bfae-4dce-84b9-3aa6551b6454 service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3203497
May 26 14:57:35.750532 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Allocated IP 172.20.0.2 (9a6b2b45-d448-425b-9716-75ffabad6539/455a1c06-d094-4995-9b7a-561be9ec484c/8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:35.806729 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-35fbf1bb-569d-4ab0-85aa-9a3c5eec20cc service neutron] 10.222.0.81 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1503057
May 26 14:57:35.841624 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Allocated IP 172.27.2.153 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/804f1d22-3cc0-476b-b4d7-d0fc2826e88a) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:35.868495 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Allocated IP 172.20.0.2 (c010dc4d-023b-4979-a482-d3b3e0924e91/09a19960-7788-4d46-a08e-92c63f201983/738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:35.874749 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.907381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.931890 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:35.973670 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.044387 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-6a1cd728-2124-42d6-80b8-566e10bd2a8d service neutron] 10.222.0.81 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2365270
May 26 14:57:36.115377 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.197358 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53876) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:36.215850 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.220827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:36.248762 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.251406 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.261676 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Transition to ACTIVE for port object 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:36.282083 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Transition to ACTIVE for port object 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:36.288899 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Allocated IP 172.27.2.87 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/c7510518-5e9a-40d3-ba66-f34a4bd5522b) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:36.293444 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Transition to ACTIVE for port object 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:36.296886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.307100 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:36.314465 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Transition to ACTIVE for port object 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:36.314934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:36.319234 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:36.327659 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:36.328804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Usage tracker for resource:security_group_rule and tenant:e10e3d6e82f1459ab59e0dc4aa35b0e4 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:36.333642 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:36.354858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:36.359098 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.371421 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:36.465238 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.470658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 53894) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:36.476410 dv-cinder-784140-4-iscsi neutron-server[103982]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 26 14:57:36.542606 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:36.558296 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:36.590034 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:36.591499 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:36.596558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:36.612068 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:36.635921 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d9ff0ee7-d6ad-48c2-a906-0d00d9596b9b req-27687947-7bf7-49ad-a9a1-7dc23aa83b54 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.1628551
May 26 14:57:36.672643 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.714786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Pushing event updated for resources: {'Port': ['ID=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:36.724146 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.503s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:36.729524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.770891 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Pushing event updated for resources: {'Port': ['ID=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:36.798633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.812273 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7a02a7c1-f03a-44fc-93e1-94f2e314758f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:36.846693 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.847078 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.847958 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.848296 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.848627 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.848937 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.849278 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.849587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.849906 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.850218 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.850528 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.850837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Tracked resource versions report:
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]: pushed versions:
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]: {   'AddressGroup': {'1.2'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'ConntrackHelper': {'1.0'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Log': {'1.0'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Network': {'1.1'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Port': {'1.7'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'PortForwarding': {'1.2'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'QosPolicy': {'1.8'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SecurityGroup': {'1.4'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SecurityGroupRule': {'1.2'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'SubPort': {'1.0'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Subnet': {'1.1'},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     'Trunk': {'1.1'}}
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]: consumer versions:
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     HyperV agent@hv-cinder-78414: {},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'ConntrackHelper': '1.0',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Log': '1.0',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Network': '1.1',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Port': '1.7',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'PortForwarding': '1.2',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'QosPolicy': '1.8',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SecurityGroup': '1.4',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SecurityGroupRule': '1.2',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'SubPort': '1.0',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Subnet': '1.1',
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:                                                      'Trunk': '1.1'}}
May 26 14:57:36.851893 dv-cinder-784140-4-iscsi neutron-server[103983]:  {{(pid=103983) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:57:36.869716 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e10e3d6e82f1459ab59e0dc4aa35b0e4&name=default HTTP/1.1" status: 200  len: 2975 time: 0.6711805
May 26 14:57:36.872889 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53916) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:36.880574 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.509s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:36.881274 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e09957c7-ad0d-4fc2-930f-d4fcd74433d7,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:36.884504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.340s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:36.919321 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.924733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:36.945599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Attempting to bind port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:36.945976 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Attempting to bind port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:36.946341 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Attempting to bind port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:36.947584 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e379bbe1-bfe1-484b-a3c0-1b7837c3504c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:36.968764 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:36.969139 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Checking segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:36.969557 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.970026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Bound using segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:36.970704 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Bound port: 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:36.971393 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:36.980569 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Attempting to bind port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:36.981181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Attempting to bind port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:36.981734 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Attempting to bind port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:36.997761 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:37.003002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Checking segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:37.003002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.003002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Bound using segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:37.003002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Bound port: 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:37.003002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.018174 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:37.026108 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:37.034939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:37.090957 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Pushing event updated for resources: {'Port': ['ID=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:37.134203 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:37.165041 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] For port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:37.170981 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] For port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:37.205040 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] For port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:37.205898 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] For port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:37.228019 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.248849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.253197 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:37.299071 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.303082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Allocated IP 172.27.2.100 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/ffc04ddb-2541-439f-a7ee-2f5bfd9daee6) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:37.304728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Pushing event updated for resources: {'Port': ['ID=c7510518-5e9a-40d3-ba66-f34a4bd5522b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:37.314825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:37.368405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Pushing event updated for resources: {'Port': ['ID=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:37.372161 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:37.372942 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.046s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:37.473619 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Pushing event updated for resources: {'Port': ['ID=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:37.476445 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.477400 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:37.621610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.634082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.834164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:37.855667 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:37.945978 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:38.009124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:38.010148 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5526715a-6f0e-4f5f-bfe5-6f15768ae713 req-c9c86059-3cce-4859-a6b5-dbe2b3145393 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.0867178
May 26 14:57:38.064275 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:38.075967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:38.158245 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Pushing event updated for resources: {'Port': ['ID=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:38.204617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:38.212840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1fb6f20c-f40d-452b-a519-7380f075c82a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:38.215868 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:38.230568 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e09957c7-ad0d-4fc2-930f-d4fcd74433d7,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:38.236121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:38.254441 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:38.255551 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e09957c7-ad0d-4fc2-930f-d4fcd74433d7 HTTP/1.1" status: 204  len: 168 time: 1.3817959
May 26 14:57:38.283930 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:38.341241 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Router 181d9a3e-c807-4252-8929-049fb54cabe7 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103981) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 14:57:38.612968 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:38.624990 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:38.638985 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:38.639604 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5083250>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:38.734844 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:38.739740 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 4.9788306
May 26 14:57:38.741130 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 53976) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:39.015398 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-29e0b837-512f-496a-b17b-99d271af6b59 None None] Network 9a6b2b45-d448-425b-9716-75ffabad6539 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:39.122526 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:39.441421 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-8c8b50d8-f039-4e3b-81c7-b6f3367d6516 None None] Provisioning for port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:39.502963 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:39.545048 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:39.620762 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28b52f0f-1508-47a7-a9b8-af335aeee75a None None] Network c010dc4d-023b-4979-a482-d3b3e0924e91 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:39.840634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54022) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:39.964615 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e3b4610b-d33c-4df8-88cd-5600d19192fb req-96241e17-6ab3-4e0e-a287-28df941da736 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.1673200
May 26 14:57:39.977174 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5083250>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:36Z', 'revision_number': 3, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:35Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:39.989295 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:39.989842 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Updating router 181d9a3e-c807-4252-8929-049fb54cabe7 port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:40.136169 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.142268 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.233427 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-0b3ec13d-a39c-42b7-90a7-841e86d630a3 None None] Provisioning for port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:40.312988 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:40.319172 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:40.319382 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.345528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.383525 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.462182 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:40.481522 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Usage tracker for resource:security_group_rule and tenant:b18f34c706ca44beb099f58943688637 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:40.500302 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:40.614541 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:40.670980 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.761429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:40.861130 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.865025 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:40.894830 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.32', 54787) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:40.947010 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:40.964596 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:40.996479 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Transition to ACTIVE for port object 804f1d22-3cc0-476b-b4d7-d0fc2826e88a will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:41.085663 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Router f41dd35f-2e02-48d1-8348-448b3cacba7e is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 14:57:41.086289 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.100672 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:41.102968 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-5e169164-5b01-4bd0-b0c3-44b158e912d2 None None] Provisioning complete for port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:41.103477 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5e169164-5b01-4bd0-b0c3-44b158e912d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.120028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.171858 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.219405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:41.225961 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:41.269813 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Pushing event updated for resources: {'Port': ['ID=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,revision_number=2']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:41.295927 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Attempting to bind port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:41.296598 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Attempting to bind port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:41.297164 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Attempting to bind port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:41.308622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-1c3782af-5af2-4656-80cf-dbf10812b87e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:41.310004 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:41.310199 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-1c3782af-5af2-4656-80cf-dbf10812b87e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.32 "GET /v2.0/networks?id=fc8154d0-713e-4031-a1fb-bb0dd6440711 HTTP/1.1" status: 200  len: 810 time: 0.4100370
May 26 14:57:41.310724 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:41.311528 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.312111 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:41.312764 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Bound port: 804f1d22-3cc0-476b-b4d7-d0fc2826e88a, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:41.313347 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.316978 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Router 06efab40-5c90-4029-a486-99daed3d6b39 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 14:57:41.329857 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.354526 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:41.359184 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.359660 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.360079 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.360624 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.361033 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.361410 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.361800 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.362358 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.368303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.368303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.368303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.368303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:57:41.368733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:41.368733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Tracked resource versions report:
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]: pushed versions:
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]: {   'AddressGroup': {'1.2'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'ConntrackHelper': {'1.0'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Log': {'1.0'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Network': {'1.1'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Port': {'1.7'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'PortForwarding': {'1.2'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'QosPolicy': {'1.8'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SecurityGroup': {'1.4'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SecurityGroupRule': {'1.2'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'SubPort': {'1.0'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Subnet': {'1.1'},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     'Trunk': {'1.1'}}
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]: consumer versions:
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]: {   DHCP agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     HyperV agent@hv-cinder-78414: {},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     L3 agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     Metadata agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     Metering agent@dv-cinder-784140-4-iscsi: {},
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:     Open vSwitch agent@dv-cinder-784140-4-iscsi: {   'AddressGroup': '1.2',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'ConntrackHelper': '1.0',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Log': '1.0',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Network': '1.1',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Port': '1.7',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'PortForwarding': '1.2',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'QosPolicy': '1.8',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SecurityGroup': '1.4',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SecurityGroupRule': '1.2',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'SubPort': '1.0',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Subnet': '1.1',
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:                                                      'Trunk': '1.1'}}
May 26 14:57:41.369117 dv-cinder-784140-4-iscsi neutron-server[103984]:  {{(pid=103984) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 26 14:57:41.381404 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:41.411573 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b4d0a83b-e02b-4234-a42a-f909cda4907f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:41.430535 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Request body: {'port': {'device_id': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711', 'admin_state_up': True, 'tenant_id': 'e0f665681e524725b9abb121531f47a5'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:41.474135 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] For port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:41.485928 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] For port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:41.486396 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0b969bb8-1e96-439e-9584-e79f20ee20e6 req-2cc23e62-9e50-40d5-92ba-d23965b7b2b9 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.2086508
May 26 14:57:41.538253 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b18f34c706ca44beb099f58943688637&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6966488
May 26 14:57:41.554161 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2969da16-1085-4511-9e5f-002603b881a8,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:41.574485 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.578794 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:41.609073 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.624636 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54078) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:41.643412 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:41.643606 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54088) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:41.671947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:41.674037 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Pushing event updated for resources: {'Port': ['ID=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:41.678269 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:41.702008 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:41.702999 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5083250>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:41.742463 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:41.758118 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:41.762206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Sync routers for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:41.789954 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f79b3b34-73f0-4d9e-a7ef-d0e8d16f1003 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:41.893690 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:41.919461 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:41.920612 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:41.962828 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:41.964738 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41a4790>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:42.035445 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:42.049571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.071479 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.115531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:42.117576 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.122300 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Usage tracker for resource:security_group_rule and tenant:84b20c3f1c7c4f209895f23d2d392159 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:42.125654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:42.127374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:42.138433 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:42.197276 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Allocated IP 172.20.0.1 (9a6b2b45-d448-425b-9716-75ffabad6539/455a1c06-d094-4995-9b7a-561be9ec484c/56817f6f-822d-4a68-9672-25adff526515) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:42.218208 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:42.235527 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Usage tracker for resource:port and tenant:e0f665681e524725b9abb121531f47a5 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:42.238648 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.238648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 8.5246034
May 26 14:57:42.241434 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54116) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:42.241945 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Quota usage for port was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:42.252989 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:42.254082 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.262913 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:42.336857 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.344986 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.350756 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 8.5506113
May 26 14:57:42.351109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:42.359125 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54130) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:42.408232 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:42.430369 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.437956 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Made reservation on behalf of e0f665681e524725b9abb121531f47a5 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:42.440461 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:42.442176 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4dd64c0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:42.463991 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.481596 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.538017 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:42.586959 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-65505cf4-e693-46d1-b3d8-cee1c9413fe7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:42.604282 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.605524 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/2969da16-1085-4511-9e5f-002603b881a8 HTTP/1.1" status: 204  len: 168 time: 0.9796574
May 26 14:57:42.620444 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=84b20c3f1c7c4f209895f23d2d392159&name=default HTTP/1.1" status: 200  len: 2975 time: 0.9763038
May 26 14:57:42.632792 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2969da16-1085-4511-9e5f-002603b881a8,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:42.643343 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54148) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:42.646160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:42.707381 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:42.823288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=00acdebb-1f6d-4270-bf48-859202139011,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:42.840575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:42.908722 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41a4790>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:38Z', 'revision_number': 3, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:42.931298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Checking router: f41dd35f-2e02-48d1-8348-448b3cacba7e for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:42.931938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Updating router f41dd35f-2e02-48d1-8348-448b3cacba7e port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:42.939411 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:42.985798 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa req-d524343b-25c0-4a54-b771-8d08a28b1110 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.1463006
May 26 14:57:43.057429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.103136 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.144560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.151385 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Transition to ACTIVE for port object 56817f6f-822d-4a68-9672-25adff526515 will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:43.203051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Allocated IP 172.20.0.2 (fc8154d0-713e-4031-a1fb-bb0dd6440711/fff245df-826f-4da5-acad-7148fe1aea38/24b593cd-0651-4f0f-aa78-c431b4dbb3f1) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:43.309449 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.330679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f357cba2-4618-49ac-9754-20efe5d82941 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:43.439809 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5083250>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:36Z', 'revision_number': 3, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:43.446145 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4dd64c0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:37Z', 'revision_number': 3, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:36Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:43.448120 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2101d03c-4b5c-4792-a5e5-68a14f49e6a7 None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:36Z', 'revision_number': 3, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:57:43.452308 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:43.452308 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Updating router 06efab40-5c90-4029-a486-99daed3d6b39 port c7510518-5e9a-40d3-ba66-f34a4bd5522b binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:43.537601 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.545373 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.594247 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:43.704142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:43.741178 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:43.742341 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.779052 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Pushing event updated for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:43.793700 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.463s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:43.797437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.100s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:43.799811 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54166) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:43.829626 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=00acdebb-1f6d-4270-bf48-859202139011,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:43.837501 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:43.924948 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.925201 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:43.925716 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/00acdebb-1f6d-4270-bf48-859202139011 HTTP/1.1" status: 204  len: 168 time: 1.2739089
May 26 14:57:43.970044 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Transition to ACTIVE for port object ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:44.015924 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:44.133708 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.170501 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.177731 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:44.499717 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Attempting to bind port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:44.500434 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Attempting to bind port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:44.501050 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Attempting to bind port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:44.511578 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Pushing event updated for resources: {'Port': ['ID=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:44.525587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.348s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:44.526889 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:44.527705 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:44.528713 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.529711 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:44.530427 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Bound port: ffc04ddb-2541-439f-a7ee-2f5bfd9daee6, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:44.531019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.567140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-dee754d0-4866-44f0-b6a5-a9cd3688c1d6 None None] Provisioning for port 56817f6f-822d-4a68-9672-25adff526515 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:44.573680 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.601836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.634814 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-dee754d0-4866-44f0-b6a5-a9cd3688c1d6 None None] Provisioning complete for port 56817f6f-822d-4a68-9672-25adff526515 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:44.635192 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-dee754d0-4866-44f0-b6a5-a9cd3688c1d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.679053 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df req-52626182-019e-4ec1-8294-14f58da116c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Synchronizing usage tracker for tenant:e0f665681e524725b9abb121531f47a5 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:44.890904 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:44.924888 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Transition to ACTIVE for port object c7510518-5e9a-40d3-ba66-f34a4bd5522b will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:44.932486 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] For port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:44.939457 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] For port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:44.986974 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:44.989573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.008402 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.014373 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-bc687a55-3970-49f0-9fe6-be8da6afaaec None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:45.073525 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.098527 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.108515 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df req-52626182-019e-4ec1-8294-14f58da116c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Unset dirty status for tenant:e0f665681e524725b9abb121531f47a5 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:57:45.109873 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df req-52626182-019e-4ec1-8294-14f58da116c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.5116253
May 26 14:57:45.110381 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:45.158399 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.161235 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.166319 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:45.177934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:45.218227 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Usage tracker for resource:security_group_rule and tenant:b77ead9a04b646e3828a946710206567 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:45.235926 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:45.237000 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Pushing event updated for resources: {'Port': ['ID=c7510518-5e9a-40d3-ba66-f34a4bd5522b,revision_number=2']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:45.246399 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.232s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:45.292160 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Attempting to bind port c7510518-5e9a-40d3-ba66-f34a4bd5522b on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:45.292531 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Attempting to bind port c7510518-5e9a-40d3-ba66-f34a4bd5522b by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:45.294950 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Attempting to bind port c7510518-5e9a-40d3-ba66-f34a4bd5522b on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:45.304393 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.321837 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:45.330230 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:45.330230 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.330230 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:45.330230 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Bound port: c7510518-5e9a-40d3-ba66-f34a4bd5522b, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:45.330230 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.330740 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-dee754d0-4866-44f0-b6a5-a9cd3688c1d6 None None] Port 56817f6f-822d-4a68-9672-25adff526515 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:57:45.354489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:45.436232 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Pushing event updated for resources: {'Port': ['ID=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:45.456336 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.339s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:45.748962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:45.748962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41a4790>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:45.749525 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] For port c7510518-5e9a-40d3-ba66-f34a4bd5522b, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:45.749525 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] For port c7510518-5e9a-40d3-ba66-f34a4bd5522b, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=c7510518-5e9a-40d3-ba66-f34a4bd5522b,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:45.750011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54200) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:45.750514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Network fc8154d0-713e-4031-a1fb-bb0dd6440711 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:45.750514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:45.750514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Pushing event updated for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:45.755817 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.781921 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:45.806508 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:45.806937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:45.806937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.807251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:45.819043 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:45.860221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:45.864351 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Usage tracker for resource:security_group_rule and tenant:e1602f854c3144e789e077395e580447 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:45.887747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:45.887747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:45.962318 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Pushing event updated for resources: {'Port': ['ID=c7510518-5e9a-40d3-ba66-f34a4bd5522b,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:45.983809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:45.987196 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:45.989889 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:45.990811 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:45.996505 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4dd64c0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:46.008688 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.842s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:46.012098 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.594s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:46.030600 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.086923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54208) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:46.131887 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.7281888
May 26 14:57:46.135477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.187780 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 804f1d22-3cc0-476b-b4d7-d0fc2826e88a up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:46.297012 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.304121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-baac6267-28c8-4d4e-90ef-0136b3468443 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103981) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:57:46.305011 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-baac6267-28c8-4d4e-90ef-0136b3468443 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1515934
May 26 14:57:46.306495 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Pushing event updated for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:46.331958 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.319s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:46.401818 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:46.553639 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-668628615-network', 'tenant_id': '5ca31a044ec5469880d1d95abddf0c2a'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:46.567461 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:46.588197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Usage tracker for resource:network and tenant:5ca31a044ec5469880d1d95abddf0c2a is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:46.594476 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:57:46.601054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:46.602060 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.620493 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:46.758707 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-4f058895-417e-4c63-9c6f-1e2e3aeaaa1c None None] Provisioning complete for port 56817f6f-822d-4a68-9672-25adff526515 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:46.760742 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4f058895-417e-4c63-9c6f-1e2e3aeaaa1c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.823275 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Made reservation on behalf of 5ca31a044ec5469880d1d95abddf0c2a for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:46.838612 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:46.908551 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-4f058895-417e-4c63-9c6f-1e2e3aeaaa1c None None] Port 56817f6f-822d-4a68-9672-25adff526515 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:57:46.929138 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:46.935833 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:46.943717 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.015407 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4dd64c0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:37Z', 'revision_number': 3, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:47.031403 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa5e511e-8b70-404f-b0fb-90b2e53ea553 None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:37Z', 'revision_number': 3, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:57:47.091355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Allocated IP 172.20.0.1 (bc70d705-69d9-4bd7-ad11-798aa6a60676/71664cfa-bf05-4585-89e0-ac077a670be9/7f9922c0-fffc-4dc7-94bc-7dfff6c80494) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:47.092262 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:47.095737 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.116131 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:47.125294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41a4790>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:38Z', 'revision_number': 3, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:47.131539 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] 10.222.0.81 "PUT /v2.0/routers/181d9a3e-c807-4252-8929-049fb54cabe7/add_router_interface HTTP/1.1" status: 200  len: 503 time: 8.3887241
May 26 14:57:47.140737 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:47.145730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Usage tracker for resource:security_group_rule and tenant:5ca31a044ec5469880d1d95abddf0c2a is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:47.148716 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:47.155494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:47.198290 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:47.199382 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac43a2850>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:47.223054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Request body: {'port': {'device_id': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:47.297605 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75f09348-0f3f-4f7c-b530-4ddca7bca37c None None] The sync data for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi is: [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:38Z', 'revision_number': 3, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:57:47.354323 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.414632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:47.422150 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.476762 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:47.580744 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.586564 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.598559 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:47.757012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:47.762092 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:47.942662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:47.973843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:47.994734 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.041849 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.162225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:48.192138 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b77ead9a04b646e3828a946710206567&name=default HTTP/1.1" status: 200  len: 2978 time: 4.3878522
May 26 14:57:48.200174 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:48.201107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54238) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:48.220220 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:48.226970 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:48.227460 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.259991 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device c7510518-5e9a-40d3-ba66-f34a4bd5522b up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:48.313208 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1211}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:48.385598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.388041 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Added segment 7d67154b-2fae-4beb-aa40-8c26cb8fd037 of type vlan for network b7dae7b0-285c-4667-aaff-d935199456fd
May 26 14:57:48.459470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bea2ed7-cb75-45b8-b8dd-a4f7bd1a0157,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:48.463310 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.477277 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.277s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:48.741581 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54244) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:48.778907 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:57:48.794722 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.822499 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8375f080-ab1b-4758-a92f-0b077d2b072f,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:48.833054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.417s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:48.852320 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Transition to ACTIVE for port object 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:48.874574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1735163795', 'description': 'tempest-description--1535414706'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:48.888283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:48.891247 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port c7510518-5e9a-40d3-ba66-f34a4bd5522b completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:48.902223 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port c7510518-5e9a-40d3-ba66-f34a4bd5522b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:48.903170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.907113 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:48.911423 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:48.928721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:48.945608 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-dc7ff2ae-5ab8-41b7-95a9-5d63e035f3d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.794s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:48.958530 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:48.964651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:49.089075 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac43a2850>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 2, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:49.116448 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:49.116618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Updating router 181d9a3e-c807-4252-8929-049fb54cabe7 port 56817f6f-822d-4a68-9672-25adff526515 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:49.182869 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Pushing event updated for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:49.184633 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.209719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.244s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:49.213977 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.224001 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.250280 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Allocated IP 172.20.0.1 (c010dc4d-023b-4979-a482-d3b3e0924e91/09a19960-7788-4d46-a08e-92c63f201983/7d4cf06f-48f0-4f53-bdcb-f793e017b221) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:49.250607 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port c7510518-5e9a-40d3-ba66-f34a4bd5522b, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=c7510518-5e9a-40d3-ba66-f34a4bd5522b,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:49.288471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 req-43b5afa4-cc63-496e-b487-d1a4e15f39b7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:49.296173 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 req-43b5afa4-cc63-496e-b487-d1a4e15f39b7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 931 time: 2.6872718
May 26 14:57:49.372019 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.384380 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:49.385138 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.393055 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:49.427940 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.436959 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:49.460126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.465065 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:49.469267 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:49.473796 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:49.479862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:49.577387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=c7510518-5e9a-40d3-ba66-f34a4bd5522b,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:49.584098 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.586070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Pushing event updated for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:49.590606 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.645s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:49.636894 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:49.715022 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Attempting to bind port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:49.716577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Attempting to bind port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1228, 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:49.717358 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Attempting to bind port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 on network fc8154d0-713e-4031-a1fb-bb0dd6440711 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:49.720733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Pushing event updated for resources: {'Network': ['ID=b7dae7b0-285c-4667-aaff-d935199456fd,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:49.735165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:49.737400 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 3.6330149
May 26 14:57:49.740773 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54256) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:49.744167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 on network fc8154d0-713e-4031-a1fb-bb0dd6440711 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:57:49.744809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Attempting to bind port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 on network fc8154d0-713e-4031-a1fb-bb0dd6440711 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:49.746021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network b7dae7b0-285c-4667-aaff-d935199456fd details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:49.754185 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Request body: {'subnet': {'network_id': 'b7dae7b0-285c-4667-aaff-d935199456fd', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-668628615-subnet', 'tenant_id': '5ca31a044ec5469880d1d95abddf0c2a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:49.761203 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:49.762007 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Checking segment: {'id': 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1228, 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:49.762957 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Bound using segment: {'id': 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1228, 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:49.763614 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Bound port: 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1228, 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:49.764240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.771849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 req-cf8d5906-6675-41ac-964d-4088e3be4fb4 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Synchronizing usage tracker for tenant:e0f665681e524725b9abb121531f47a5 on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:49.793133 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:49.800818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.892852 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Usage tracker for resource:subnet and tenant:5ca31a044ec5469880d1d95abddf0c2a is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:49.900198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.925778 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:49.949507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:49.954474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:49.959899 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7e072026-50e3-4a36-884b-3f64ed386e42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:50.043357 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.055142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a756592d-fa3e-464c-8999-dda2f61db3ea,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:50.064602 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Transition to ACTIVE for port object 56817f6f-822d-4a68-9672-25adff526515 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:50.086991 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Made reservation on behalf of 5ca31a044ec5469880d1d95abddf0c2a for: {'subnet': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:50.090708 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Notify callbacks [] for subnet, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.108542 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:50.132955 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:50.157082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.199191 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.227752 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d6e9b39e-7517-42a8-9925-c169153773ee admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e1602f854c3144e789e077395e580447&name=default HTTP/1.1" status: 200  len: 2979 time: 4.4926522
May 26 14:57:50.244927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54260) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:50.257373 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:50.262367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 req-cf8d5906-6675-41ac-964d-4088e3be4fb4 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Unset dirty status for tenant:e0f665681e524725b9abb121531f47a5 on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:57:50.270875 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 req-cf8d5906-6675-41ac-964d-4088e3be4fb4 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.9737837
May 26 14:57:50.311048 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0219a3bc-1111-4434-925e-612ae7df5982,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:50.336509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.377s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:50.339017 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.256s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:50.339375 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:50.351266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,segment=NetworkSegment(fc5f4185-4145-44ee-8d30-2fdc2c29ad21),segment_id=fc5f4185-4145-44ee-8d30-2fdc2c29ad21)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:50.431256 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.433735 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.436958 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.500268 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Transition to ACTIVE for port object 7d4cf06f-48f0-4f53-bdcb-f793e017b221 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:50.641005 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Pushing event updated for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:50.656768 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-382ece8a-24fe-4efc-9ce4-8938eabc57b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.662221 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.404s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:50.670413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.672017 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 1.8826742
May 26 14:57:50.677479 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Attempting to bind port 56817f6f-822d-4a68-9672-25adff526515 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:50.677920 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Attempting to bind port 56817f6f-822d-4a68-9672-25adff526515 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:50.678454 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Attempting to bind port 56817f6f-822d-4a68-9672-25adff526515 on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:50.689619 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:50.690333 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Checking segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:50.691540 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.692075 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Bound using segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:50.692748 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Bound port: 56817f6f-822d-4a68-9672-25adff526515, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:50.693307 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.696390 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54264) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:50.736862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group_rule': {'security_group_id': '0219a3bc-1111-4434-925e-612ae7df5982', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:50.750018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:50.760268 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:50.766724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:50.776973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:50.784723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:50.791723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:50.808786 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:50.809442 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.911291 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.934322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] For port 56817f6f-822d-4a68-9672-25adff526515, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:50.937859 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] For port 56817f6f-822d-4a68-9672-25adff526515, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=56817f6f-822d-4a68-9672-25adff526515,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:50.938276 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:50.938898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:50.940333 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] 10.222.0.32 "PUT /v2.0/ports/24b593cd-0651-4f0f-aa78-c431b4dbb3f1 HTTP/1.1" status: 200  len: 1093 time: 3.8456609
May 26 14:57:50.947616 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:57:51.022335 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.037417 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.046021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.056844 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.069208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-60664467-3fd9-4a52-8bcd-01861bf1155b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.080114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.117420 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.117626 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Pushing event updated for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.124547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.133803 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.386s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.196298 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8375f080-ab1b-4758-a92f-0b077d2b072f,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.201561 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.204126 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8375f080-ab1b-4758-a92f-0b077d2b072f HTTP/1.1" status: 204  len: 168 time: 2.6171794
May 26 14:57:51.235572 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.245332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.128s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.300253 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:51.306410 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:51.307087 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac43a2850>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:51.376491 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.414158 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Pushing event updated for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.415675 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.431206 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:51.439139 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.444056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:51.482372 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:51.482848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.523160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a756592d-fa3e-464c-8999-dda2f61db3ea,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.527240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.530237 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1', 'status': 'completed', 'code': 200}
May 26 14:57:51.562880 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.579178 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a756592d-fa3e-464c-8999-dda2f61db3ea HTTP/1.1" status: 204  len: 168 time: 1.3202193
May 26 14:57:51.596313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.606420 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.648230 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.649064 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device c7510518-5e9a-40d3-ba66-f34a4bd5522b up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:51.678471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.690113 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.db.resource_extend [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 26 14:57:51.732853 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Pushing event updated for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.750928 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:51.752587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.784162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.792685 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Checking segment: {'id': '7d67154b-2fae-4beb-aa40-8c26cb8fd037', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': 'b7dae7b0-285c-4667-aaff-d935199456fd'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:51.793094 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Network hostable DHCP agents. Network: b7dae7b0-285c-4667-aaff-d935199456fd, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103981) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:57:51.799109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.719s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.801854 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.116s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.808421 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.809672 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4cc62b32-f596-467b-a43a-29eccbb3a48b,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.813413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.849812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07d726c-d2dd-4d46-a061-64fcfd28a625 req-dea51929-f6bf-439e-9bfa-79174fb66de8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:51.850540 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e07d726c-d2dd-4d46-a061-64fcfd28a625 req-dea51929-f6bf-439e-9bfa-79174fb66de8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.2798274
May 26 14:57:51.854238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.855155 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46c33957-3af6-4538-9606-fcd4c550c37b,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:51.864910 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:51.874048 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:51.874048 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:51.963507 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Network b7dae7b0-285c-4667-aaff-d935199456fd is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103981) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:57:51.999198 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:52.004268 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:52.006593 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e07d726c-d2dd-4d46-a061-64fcfd28a625 req-369de986-94e7-46ae-a3cf-698ccb5be4ce tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1452525
May 26 14:57:52.007395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.011523 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54300) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:52.017221 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group_rule': {'security_group_id': '0219a3bc-1111-4434-925e-612ae7df5982', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:52.023255 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.3245978
May 26 14:57:52.035277 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:52.039352 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:52.043371 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:52.050215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:52.076364 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, b7dae7b0-285c-4667-aaff-d935199456fd) {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:52.083521 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:52.084166 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.088730 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Pushing event updated for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:52.102767 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:52.115133 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-281f6b5f-9f11-4ed2-9914-274ad55085f0 None None] Network b7dae7b0-285c-4667-aaff-d935199456fd requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:52.150609 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port c7510518-5e9a-40d3-ba66-f34a4bd5522b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:52.150883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.168189 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:52.174747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:52.184018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.359132 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.368815 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 2.6188111
May 26 14:57:52.420920 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.421133 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Router f41dd35f-2e02-48d1-8348-448b3cacba7e has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:57:52.422932 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:52.447769 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6cc9cfb7-a1d2-459c-b33c-2c0b4ba782ad None None] Provisioning for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:52.465653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6cc9cfb7-a1d2-459c-b33c-2c0b4ba782ad None None] Provisioning complete for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:52.466037 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6cc9cfb7-a1d2-459c-b33c-2c0b4ba782ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.472515 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8bb8111e-94ce-4834-aba9-99e24694d2b4,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:52.496840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:52.527660 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.573755 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.579310 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.5666111
May 26 14:57:52.580145 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54326) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:52.587890 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:52.595635 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:52.602316 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:floatingip and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:52.606511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:52.615167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:52.656791 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-6cc9cfb7-a1d2-459c-b33c-2c0b4ba782ad None None] Port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:57:52.712572 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.758587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac43a2850>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:52.762019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 804f1d22-3cc0-476b-b4d7-d0fc2826e88a up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:52.799094 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8a801ec-0963-408d-9e70-cc9a9a507b1e None None] Network b7dae7b0-285c-4667-aaff-d935199456fd requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:57:52.835201 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-384446d8-00d7-413a-99a2-0089b7826074 None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:57:52.896768 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:52.980767 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:52.993917 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Sync routers for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:52.995860 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] 10.222.0.81 "PUT /v2.0/routers/f41dd35f-2e02-48d1-8348-448b3cacba7e/add_router_interface HTTP/1.1" status: 200  len: 503 time: 10.7527735
May 26 14:57:53.010404 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:53.011345 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4f1ff70>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:53.117913 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Allocated IP 172.27.2.43 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/5098d580-480b-43e1-a701-6a9a07ee4be8) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:57:53.293727 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.349880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.365686 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:53.371367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.406596 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.419254 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.420616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.424566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:53.438580 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.465076 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:53.511444 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-068e5444-afa5-4879-9f42-fddbe03d31a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.609974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=5098d580-480b-43e1-a701-6a9a07ee4be8,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:53.627019 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:53.630543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:53.727760 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:53.739726 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:53.747543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:57:53.789630 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Pushing event updated for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:53.811676 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.387s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:53.892701 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b req-408ef7d2-838d-4737-b7bc-538860036bc0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:53.899960 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b req-408ef7d2-838d-4737-b7bc-538860036bc0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.5461385
May 26 14:57:53.946833 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:53.984350 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b req-9436ee53-ff1a-406e-85ac-46353e4e5872 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0811903
May 26 14:57:54.020178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:57:54.022925 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:57:54.055429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:54.255416 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:54.263176 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:54.527386 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:54.528984 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:54.566555 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:57:54.589825 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4f1ff70>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 4, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7f9922c0-fffc-4dc7-94bc-7dfff6c80494', 'name': '', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'mac_address': 'fa:16:3e:be:a0:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:46Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 2, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'subnets': [{'id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:54.605412 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Checking router: f41dd35f-2e02-48d1-8348-448b3cacba7e for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:54.606110 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Updating router f41dd35f-2e02-48d1-8348-448b3cacba7e port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:54.663024 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-4bb74ca6-f943-41aa-943b-86a09e526af8 None None] Provisioning complete for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:54.666276 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4bb74ca6-f943-41aa-943b-86a09e526af8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:54.790500 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:54.872090 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:55.054059 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-4bb74ca6-f943-41aa-943b-86a09e526af8 None None] Port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:57:55.055019 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-6a7e1a18-ce75-4db2-8200-71ba3a236264 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:55.055019 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-6a7e1a18-ce75-4db2-8200-71ba3a236264 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e0f665681e524725b9abb121531f47a5&device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 1096 time: 0.2803993
May 26 14:57:55.055274 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 56817f6f-822d-4a68-9672-25adff526515 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:55.126523 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-a29426c1-8db3-4b37-b41b-c70875fecc3d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1 HTTP/1.1" status: 200  len: 217 time: 0.1969597
May 26 14:57:55.141205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:57:55.176884 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] 10.222.0.81 "PUT /v2.0/routers/06efab40-5c90-4029-a486-99daed3d6b39/add_router_interface HTTP/1.1" status: 200  len: 503 time: 12.7924938
May 26 14:57:55.210647 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:57:55.231140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:55.231774 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4396e50>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:55.348256 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:55.422323 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:55.531826 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:55.569020 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-8b64630a-1f3f-4c26-9d29-78ca673e2143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:55.588580 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-8b64630a-1f3f-4c26-9d29-78ca673e2143 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=fff245df-826f-4da5-acad-7148fe1aea38 HTTP/1.1" status: 200  len: 850 time: 0.4340754
May 26 14:57:55.677571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-7f0ed4cd-4274-4454-a847-eadeb8d5420c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:55.679585 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-7f0ed4cd-4274-4454-a847-eadeb8d5420c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 818 time: 0.3915133
May 26 14:57:55.752236 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-7eabd136-a066-40ae-8396-63a386247bc1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/quotas/0ad2ab2705ca479ab4aaafe7c80de162 HTTP/1.1" status: 200  len: 375 time: 0.0451953
May 26 14:57:55.838482 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=5098d580-480b-43e1-a701-6a9a07ee4be8,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:55.843720 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-7cb573fc-60fa-421b-bc86-d6ace8d435e9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc8154d0-713e-4031-a1fb-bb0dd6440711&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2064354
May 26 14:57:55.844888 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.457s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:55.900429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:55.911750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c82128eb-a585-4f67-9715-b7826dd6aadf req-99d08977-1fe2-4028-8bd8-20248f5ecaa5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:55.926902 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c82128eb-a585-4f67-9715-b7826dd6aadf req-99d08977-1fe2-4028-8bd8-20248f5ecaa5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.6331146
May 26 14:57:55.937022 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:55.965367 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Transition to ACTIVE for port object 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:55.978903 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-f73fd2c6-dc74-44c8-b6db-72f573c23fd9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:56.054968 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.066731 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c82128eb-a585-4f67-9715-b7826dd6aadf req-ff96e8a0-d297-4246-bafb-476a393b2058 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1386395
May 26 14:57:56.070194 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.070194 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 3.4878695
May 26 14:57:56.110700 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:56.124370 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 56817f6f-822d-4a68-9672-25adff526515 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:57:56.129660 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-f73fd2c6-dc74-44c8-b6db-72f573c23fd9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:57:56.131410 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-f73fd2c6-dc74-44c8-b6db-72f573c23fd9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&fields=id HTTP/1.1" status: 200  len: 255 time: 0.3779738
May 26 14:57:56.139235 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.207591 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b66a72b-beba-4d24-a1b4-aaae93221c21 None None] Pushing event updated for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:56.326934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54418) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:56.338802 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-890752668-network', 'tenant_id': 'cc851c128d044c649d7ef02a3a136954'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:56.346115 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:56.368554 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Usage tracker for resource:network and tenant:cc851c128d044c649d7ef02a3a136954 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:56.369632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:56.409804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:56.429574 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 56817f6f-822d-4a68-9672-25adff526515 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:57:56.430283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.523224 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Made reservation on behalf of cc851c128d044c649d7ef02a3a136954 for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:56.525986 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.555892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.570501 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Attempting to bind port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:56.571007 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Attempting to bind port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:56.571485 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Attempting to bind port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 on network bc70d705-69d9-4bd7-ad11-798aa6a60676 {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:56.578429 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:56.583210 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Checking segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:56.583210 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.583918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:56.583989 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Bound using segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:56.584313 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Bound port: 7f9922c0-fffc-4dc7-94bc-7dfff6c80494, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:56.586133 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.590733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Usage tracker for resource:security_group_rule and tenant:cc851c128d044c649d7ef02a3a136954 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:56.595675 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:56.616212 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:56.657026 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-4b66a72b-beba-4d24-a1b4-aaae93221c21 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.557s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:56.822283 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-0ed75a36-86c7-41c6-8367-c10b26d65c6a service neutron] 10.222.0.32 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6308892
May 26 14:57:56.841181 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.862079 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] For port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:57:56.866982 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] For port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:57:56.960811 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.965477 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:56.977259 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:56.993373 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c8d35d68-6aeb-44fa-b835-d60a68cf7fa1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:57.071180 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1233}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:57:57.090440 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.110710 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5addf094-223c-49cc-8781-11667e517c5b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:57.122862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:57.123950 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.124291 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Added segment e2049b10-19df-4bc0-9b62-0782ed0807dc of type vlan for network e4ad6b8e-994d-46c5-a542-0429b253ad09
May 26 14:57:57.189067 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b66a72b-beba-4d24-a1b4-aaae93221c21 None None] Pushing event updated for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:57.194024 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-4b66a72b-beba-4d24-a1b4-aaae93221c21 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:57.207704 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4396e50>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 2, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:57.208279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.208376 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:57:57.208648 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Updating router 06efab40-5c90-4029-a486-99daed3d6b39 port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:57:57.209957 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:57:57.210817 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4f1ff70>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:57.317618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 56817f6f-822d-4a68-9672-25adff526515, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=56817f6f-822d-4a68-9672-25adff526515,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:57:57.341129 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.343690 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:57.343690 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.349857 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:57.363525 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.460865 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.479506 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:57.600359 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:57:57.614526 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Pushing event updated for resources: {'Network': ['ID=e4ad6b8e-994d-46c5-a542-0429b253ad09,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:57.631475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:57.657404 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network e4ad6b8e-994d-46c5-a542-0429b253ad09 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:57:57.666294 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 1.3382742
May 26 14:57:57.669122 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54446) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:57.677270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Request body: {'subnet': {'network_id': 'e4ad6b8e-994d-46c5-a542-0429b253ad09', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-890752668-subnet', 'tenant_id': 'cc851c128d044c649d7ef02a3a136954', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:57.692347 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:57.704781 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Usage tracker for resource:subnet and tenant:cc851c128d044c649d7ef02a3a136954 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:57.716229 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:57.736307 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:57.832291 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Made reservation on behalf of cc851c128d044c649d7ef02a3a136954 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:57:57.835284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Notify callbacks [] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.863391 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:57.875616 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a0d743e-dab1-485b-9120-aa1a52e823f7 req-96dbfc69-86f6-4cc3-96e2-91db06c390e5 service neutron] 10.222.0.32 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4370930
May 26 14:57:57.969970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54464) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:57:57.976142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1352716442', 'description': 'tempest-description--1817350134'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:57:57.995870 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:58.011938 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:58.163979 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-38aa3aee-66a8-435e-b7f0-682373308753 service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 14:57:58.168507 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-38aa3aee-66a8-435e-b7f0-682373308753 service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.8887918
May 26 14:57:58.280128 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:58.295167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:58.349869 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4f1ff70>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 4, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7f9922c0-fffc-4dc7-94bc-7dfff6c80494', 'name': '', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'mac_address': 'fa:16:3e:be:a0:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:46Z', 'updated_at': '2021-05-26T14:57:56Z', 'revision_number': 4, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'subnets': [{'id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:57:58.355213 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4d93ea05-de34-4994-ac10-54600037edb2 None None] The sync data for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi is: [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:50Z', 'revision_number': 4, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7f9922c0-fffc-4dc7-94bc-7dfff6c80494', 'name': '', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'mac_address': 'fa:16:3e:be:a0:27', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_interface', 'standard_attr_id': 104, 'fixed_ips': [{'subnet_id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:46Z', 'updated_at': '2021-05-26T14:57:56Z', 'revision_number': 4, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'subnets': [{'id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:57:58.495357 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:58.615529 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-7916f5e4-a8c3-472e-9b58-57074bba8848 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:58.616858 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:58.656742 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.178s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:58.673827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:57:58.680110 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:57:58.684508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:57:58.736305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:57:58.784745 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-7916f5e4-a8c3-472e-9b58-57074bba8848 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:57:58.797821 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-7916f5e4-a8c3-472e-9b58-57074bba8848 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1735163795&fields=id&tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 267 time: 0.5210674
May 26 14:57:58.826665 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-bd3ead54-4e56-4e68-9f02-d62627c86531 service neutron] 10.222.0.81 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6444645
May 26 14:57:58.927242 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:58.943890 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Transition to ACTIVE for port object 7d4cf06f-48f0-4f53-bdcb-f793e017b221 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:57:59.021208 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:59.037213 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:57:59.213215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-de71db3e-e2fa-4a4f-8554-72bc839f1a74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:59.214788 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-de71db3e-e2fa-4a4f-8554-72bc839f1a74 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=e0f665681e524725b9abb121531f47a5&device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 1096 time: 1.1124821
May 26 14:57:59.288080 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:57:59.312142 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-16aa75fa-7797-43bb-9692-7fd224bd68fd service neutron] 10.222.0.81 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4244294
May 26 14:57:59.450561 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-b72b4f2f-ac55-4814-95fb-70eb93d3265b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:59.457420 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-b72b4f2f-ac55-4814-95fb-70eb93d3265b service neutron] 10.222.0.32 "GET /v2.0/networks?id=fc8154d0-713e-4031-a1fb-bb0dd6440711 HTTP/1.1" status: 200  len: 912 time: 0.2139635
May 26 14:57:59.670730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:59.699143 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-d05e70c1-7e76-451b-b885-cc9006bc50d8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:59.699873 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-d05e70c1-7e76-451b-b885-cc9006bc50d8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:network {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:57:59.706706 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Attempting to bind port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:57:59.707883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Attempting to bind port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:57:59.708722 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Attempting to bind port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:57:59.713262 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Pushing event updated for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:57:59.723061 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.694s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:57:59.751663 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-c519eb52-6b84-4109-88e1-e9bd9f7007c6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1 HTTP/1.1" status: 200  len: 217 time: 0.2632017
May 26 14:57:59.763604 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:57:59.765235 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Checking segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:57:59.765975 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:59.769293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Bound using segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:57:59.770120 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Bound port: 7d4cf06f-48f0-4f53-bdcb-f793e017b221, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:57:59.787381 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:59.953930 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-216309c5-0869-4f90-b5db-bb469ea69f1b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:57:59.963843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 56817f6f-822d-4a68-9672-25adff526515 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:57:59.968495 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-216309c5-0869-4f90-b5db-bb469ea69f1b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=fff245df-826f-4da5-acad-7148fe1aea38 HTTP/1.1" status: 200  len: 850 time: 0.2047889
May 26 14:57:59.968495 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:57:59.997264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c6892895-fe92-466d-9ced-f25fd36f1f02 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:00.169511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-d05e70c1-7e76-451b-b885-cc9006bc50d8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:network {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:00.170712 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-d05e70c1-7e76-451b-b885-cc9006bc50d8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 810 time: 1.3719475
May 26 14:58:00.202510 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] For port 7d4cf06f-48f0-4f53-bdcb-f793e017b221, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:00.208070 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-57d6b969-064b-4146-8247-17719aab778b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=fc8154d0-713e-4031-a1fb-bb0dd6440711&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2179856
May 26 14:58:00.213125 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] For port 7d4cf06f-48f0-4f53-bdcb-f793e017b221, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d4cf06f-48f0-4f53-bdcb-f793e017b221,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:00.215486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:00.220459 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 2.2467155
May 26 14:58:00.226603 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 56817f6f-822d-4a68-9672-25adff526515 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:00.226981 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:00.237807 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54524) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:00.248983 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:00.261883 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:00.266695 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group_rule': {'security_group_id': '1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:00.273356 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-cfa78341-172d-4e05-b6e6-62b9999b3b20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/quotas/81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 375 time: 0.0780156
May 26 14:58:00.275243 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.284s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:00.277340 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:00.292778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-cdb0ae58-302e-49f8-8b84-e0bfae10a2c0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:00.298735 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:00.334525 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:00.354521 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:00.362588 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:00.430214 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:00.485134 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6c42b67-62c1-43d0-9be6-9b43dc14a8c7,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:00.510338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:00.543284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Checking segment: {'id': 'e2049b10-19df-4bc0-9b62-0782ed0807dc', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': 'e4ad6b8e-994d-46c5-a542-0429b253ad09'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:00.543822 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Network hostable DHCP agents. Network: e4ad6b8e-994d-46c5-a542-0429b253ad09, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:58:00.582743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3de53794-a254-47ce-8122-b8142aa706dd req-5784f60a-eec4-40c2-bf1f-775221e9f8ed tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:00.592547 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3de53794-a254-47ce-8122-b8142aa706dd req-5784f60a-eec4-40c2-bf1f-775221e9f8ed tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.5513372
May 26 14:58:00.619606 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Pushing event updated for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:00.624711 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-1a3983a4-0270-4a3a-9355-0fc280411064 service neutron] 10.222.0.32 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3485298
May 26 14:58:00.627265 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:00.633387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:00.634128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:58:00.634738 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4396e50>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:57:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:00.761235 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-fbd5a659-e07f-4ed7-a283-58198c104365 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:00.775128 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3de53794-a254-47ce-8122-b8142aa706dd req-733d99ce-0497-4a0c-a71c-fb1203d5f7b7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1816080
May 26 14:58:00.974109 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Network e4ad6b8e-994d-46c5-a542-0429b253ad09 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:58:01.011795 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eb8d8cfc-93ce-4f72-9b9c-6992aaba2522 req-74fc42ef-4770-4f4f-9879-bca5c19c78af tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 210 time: 0.1691473
May 26 14:58:01.016447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:01.069589 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-11e925b6-7723-455b-ab7d-836f430888df service neutron] 10.222.0.32 "GET /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4265318
May 26 14:58:01.075852 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-fbd5a659-e07f-4ed7-a283-58198c104365 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:01.080473 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:58:01.084154 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, e4ad6b8e-994d-46c5-a542-0429b253ad09) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:01.088047 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-fbd5a659-e07f-4ed7-a283-58198c104365 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&fields=id HTTP/1.1" status: 200  len: 348 time: 0.7589040
May 26 14:58:01.088504 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:01.089056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:01.094787 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:01.097531 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-76852916-533f-4622-bc87-9d6158ff10b9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:01.188171 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f73200bb-b7eb-4589-a9e1-9c63dc8d9666 None None] Network e4ad6b8e-994d-46c5-a542-0429b253ad09 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:01.199444 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f121e327-07fe-4be6-9a88-e70ae74f7504,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:01.207209 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:01.258015 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 3.5867627
May 26 14:58:01.319427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:01.323408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54576) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:01.329653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group_rule': {'security_group_id': '1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:01.335527 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.0944743
May 26 14:58:01.344996 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:01.366299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:01.382306 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:01.394226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:01.486301 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-1feecf69-7d7b-4648-9a72-7d185613790d service neutron] 10.222.0.81 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3614419
May 26 14:58:01.520356 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54600) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:01.580572 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:01.740684 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:01.905304 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-ccec4371-93d4-4bff-9518-a28dcdf2e670 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:01.915231 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-ccec4371-93d4-4bff-9518-a28dcdf2e670 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 818 time: 0.4511971
May 26 14:58:01.931822 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-5e63bd00-bbcc-4967-b88a-b21ade734e89 service neutron] 10.222.0.81 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4446445
May 26 14:58:01.950885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Deleting subnet 4cc62b32-f596-467b-a43a-29eccbb3a48b {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 14:58:01.961222 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-2cd7b3be-f533-4091-9606-08952fb28a78 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/quotas/0ad2ab2705ca479ab4aaafe7c80de162 HTTP/1.1" status: 200  len: 375 time: 0.0447991
May 26 14:58:01.974175 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7867247b-d6c8-4acc-bbb0-ad309c5b4c59 None None] Network e4ad6b8e-994d-46c5-a542-0429b253ad09 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:01.990255 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.059022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.083583 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:02.096484 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:02.097346 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.116368 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.131097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d7166b46-b92f-4822-8931-81b0e4b7cd64 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:02.172671 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=334c7bb4-919c-4ca0-94ac-003fde18ce61,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:02.177019 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:02.179720 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.189626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.294593 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4396e50>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:00Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:02.299389 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54636) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:02.376759 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.381410 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54644) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:02.382063 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-76542ee9-7c2c-4006-9b66-d9b087d6eec9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.0569885
May 26 14:58:02.389224 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:02.399798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5d13cb8-9b12-42aa-9120-157d20ffc986 None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:00Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:58:02.418057 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-b4e87d24-ed50-4ed4-92b6-7757f1ccd3ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4557359
May 26 14:58:02.511118 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:02.522186 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.527007 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:floatingip and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:02.544014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:02.562197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:02.647279 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:02.656054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43644d01-a453-432a-a324-c93bff8ac6d5 req-66739645-357c-4f9b-ab4d-ec1dbd2676ea tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:02.657632 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-43644d01-a453-432a-a324-c93bff8ac6d5 req-66739645-357c-4f9b-ab4d-ec1dbd2676ea tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.2535570
May 26 14:58:02.659326 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.733969 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-43644d01-a453-432a-a324-c93bff8ac6d5 req-c549c8eb-f1c7-4ec4-a9a4-74d290f05537 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0626891
May 26 14:58:02.734720 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.754396 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-a98d5a06-dd8b-4cd2-be55-290d5cf406b6 service neutron] 10.222.0.81 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3357961
May 26 14:58:02.774240 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:02.775455 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:02.780662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:02.892980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Usage tracker for resource:security_group_rule and tenant:2553c7f9de16447ab9e2566bf9ee41e6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:02.917755 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:02.965098 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d4cf06f-48f0-4f53-bdcb-f793e017b221 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:03.053087 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:03.062694 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:03.073369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.293s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:03.098229 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-77de3de9-355e-4267-86e4-b1fdebda31f8 req-41bd45e4-2bab-47e1-9cc4-1a65b2eef33d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 210 time: 0.1821635
May 26 14:58:03.197832 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:03.201031 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.207008 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:03.207648 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.228422 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:03.294107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4cc62b32-f596-467b-a43a-29eccbb3a48b,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:03.299171 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.299367 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.306612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:03.314641 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-4ea0842a-d4db-4b77-a656-8115638e2449 service neutron] 10.222.0.81 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5450547
May 26 14:58:03.316440 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d017800f-870d-4a0a-b2c1-fed987f794d8 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/4cc62b32-f596-467b-a43a-29eccbb3a48b HTTP/1.1" status: 204  len: 168 time: 1.7621851
May 26 14:58:03.324456 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54686) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:03.421274 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.435659 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.486943 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 7d4cf06f-48f0-4f53-bdcb-f793e017b221, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d4cf06f-48f0-4f53-bdcb-f793e017b221,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:03.558618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.561508 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:03.601970 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.605500 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Allocated IP 172.27.2.62 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/837c6543-81e9-4a07-90ea-cad486d8bf26) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:03.786943 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.790881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54704) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:03.807897 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:03.811301 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:03.843264 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.864294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fcac44c6d00>> segment before_delete 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.864805 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fcac44c6d00>> subnet precommit_delete_associations 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.866353 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> segment_host_mapping after_create 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.866853 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> port after_create 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.867263 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> port after_delete 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.867622 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> port after_update 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.867994 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> segment after_delete 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.868462 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> subnet after_create 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.868930 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> subnet after_delete 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.869321 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac45e16a0>> subnet after_update 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:03.877820 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:03.924782 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ef6bfcf8-e91e-494b-8b2d-a5d1269e0a95 req-f7d9471d-e697-482a-9d9e-854688c50b29 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 210 time: 0.1345274
May 26 14:58:03.965311 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2553c7f9de16447ab9e2566bf9ee41e6&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6644962
May 26 14:58:03.970463 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:03.978087 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54716) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:03.995938 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=960f2a9c-5b95-4b4a-bd77-2a4513e300b9,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:04.001483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:04.060228 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:04.074311 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.123502 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.170847 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.197281 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:04.201771 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Usage tracker for resource:security_group_rule and tenant:dac86f7c1f744baf931f2e7099075c07 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:04.205125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:04.213729 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:04.253687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.312214 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac4b06e20>> subnet after_create 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:04.312572 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac4b06e20>> subnet after_delete 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:04.324099 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,segment=NetworkSegment(fc5f4185-4145-44ee-8d30-2fdc2c29ad21),segment_id=fc5f4185-4145-44ee-8d30-2fdc2c29ad21)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:04.333062 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac4b06e20>> subnet before_create 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:04.333062 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac4b06e20>> subnet before_update 55550000 {{(pid=103982) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:04.333062 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac45e1880>,) {'filters': {'network_id': ['b7dae7b0-285c-4667-aaff-d935199456fd']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:04.339581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1', 'network_id': 'fc8154d0-713e-4031-a1fb-bb0dd6440711', 'port_id': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1', 'mac_address': 'fa:16:3e:74:74:94', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1228, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fff245df-826f-4da5-acad-7148fe1aea38', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:04.366719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:04.404173 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:04.410635 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.418977 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45e1880>, '7d67154b-2fae-4beb-aa40-8c26cb8fd037') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:04.419254 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45e1880>, '7d67154b-2fae-4beb-aa40-8c26cb8fd037') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:04.427589 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:04.432513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:04.442330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.453081 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,segment=NetworkSegment(fc5f4185-4145-44ee-8d30-2fdc2c29ad21),segment_id=fc5f4185-4145-44ee-8d30-2fdc2c29ad21)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:04.528348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.529570 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.532484 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:04.558473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Releasing vlan 1211 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 14:58:04.559238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.576509 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-059cc902-010f-4330-9a94-f837b3efcf80 req-15c6f3a3-9767-436a-a786-91e13969f485 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 210 time: 0.3211403
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   from cryptography.utils import int_from_bytes
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   from cryptography.utils import int_from_bytes
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 14:58:04.588444 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 14:58:04.628293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:04.640527 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=837c6543-81e9-4a07-90ea-cad486d8bf26,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:04.652859 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:04.653223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.286s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:04.657290 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:04.695232 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 req-cac6b414-a9c7-4415-9cd9-8dec710e6c83 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:04.704436 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 req-cac6b414-a9c7-4415-9cd9-8dec710e6c83 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 943 time: 0.3449798
May 26 14:58:04.718465 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-5589ba84-6d55-4824-8c19-de808380840b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:04.719242 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-5589ba84-6d55-4824-8c19-de808380840b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:network {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:04.739428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.748249 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 req-7f6743c2-93a0-46f5-b629-796a78fb823f tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427308
May 26 14:58:04.763403 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:04.775420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['24b593cd-0651-4f0f-aa78-c431b4dbb3f1'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:04.786036 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=960f2a9c-5b95-4b4a-bd77-2a4513e300b9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:04.796415 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:04.819894 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.826035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.827330 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/960f2a9c-5b95-4b4a-bd77-2a4513e300b9 HTTP/1.1" status: 204  len: 168 time: 0.8481200
May 26 14:58:04.828667 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.840635 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.845020 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:04.870381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:04.880463 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] 10.222.0.81 "DELETE /v2.0/networks/b7dae7b0-285c-4667-aaff-d935199456fd HTTP/1.1" status: 204  len: 168 time: 1.5582364
May 26 14:58:04.883513 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54744) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:04.886680 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Pushing event deleted for resources: {'Network': ['ID=b7dae7b0-285c-4667-aaff-d935199456fd,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:04.890159 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ae7ed66a-110d-4627-b2dc-0fb655845371 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:04.929124 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-5589ba84-6d55-4824-8c19-de808380840b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:network {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:04.930819 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-5589ba84-6d55-4824-8c19-de808380840b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 818 time: 0.5253100
May 26 14:58:04.931808 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d4cf06f-48f0-4f53-bdcb-f793e017b221 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:04.974816 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Request body: {'port': {'device_id': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'admin_state_up': True, 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:05.017838 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.094114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:05.094689 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.129285 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:05.238144 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54762) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:05.249114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Deleting subnet c6c42b67-62c1-43d0-9be6-9b43dc14a8c7 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 14:58:05.252291 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:05.286208 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 req-5e4313d2-718e-49b1-83ac-931834af69d7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 210 time: 0.1457219
May 26 14:58:05.287002 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.324265 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.389029 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:05.391283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.463043 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.492588 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:05.497370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Usage tracker for resource:security_group_rule and tenant:0389543517ac4f488e8543016fdd53d0 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:05.500765 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:05.509870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:05.562859 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45535656-34cf-4601-a593-ae4937d462dc,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:05.567678 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=dac86f7c1f744baf931f2e7099075c07&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7758195
May 26 14:58:05.568698 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.439s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:05.571471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54768) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:05.646086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.667729 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.668827 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.32', 54810) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:05.670536 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:05.671932 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.685009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.749654 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54776) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:05.780653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:05.795579 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.815783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:05.820010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Usage tracker for resource:security_group_rule and tenant:d4d0bb66c9e341c19ce1701e7de034b0 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:05.823151 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:05.825156 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.831886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:05.833728 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 req-b710cb59-a111-427c-bd48-03cce899a9ce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 210 time: 0.0608938
May 26 14:58:05.834490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:05.897077 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:05.962382 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0389543517ac4f488e8543016fdd53d0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7230854
May 26 14:58:05.975592 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54782) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:05.982808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fed43f83-3b90-40ae-9010-edbf43b81a9a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:05.995800 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:05.998494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Made reservation on behalf of 0ad2ab2705ca479ab4aaafe7c80de162 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:06.003602 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.008335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-ad6e6619-6332-496d-afe7-1e07179eb74c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:06.009789 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-ad6e6619-6332-496d-afe7-1e07179eb74c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 810 time: 0.3304503
May 26 14:58:06.044052 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:06.049626 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.098579 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.104532 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-26221d5c-a7e8-4471-ac22-d3453a5e108a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:06.135369 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.147837 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.156477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.163630 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-26221d5c-a7e8-4471-ac22-d3453a5e108a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:06.164381 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-26221d5c-a7e8-4471-ac22-d3453a5e108a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 380 time: 0.1407142
May 26 14:58:06.174528 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.184828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'port': {'device_id': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'admin_state_up': True, 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'security_groups': ['0219a3bc-1111-4434-925e-612ae7df5982']}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:06.200667 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45535656-34cf-4601-a593-ae4937d462dc,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.209901 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.212926 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:06.220863 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:06.232177 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:06.233101 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.233202 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.234280 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/45535656-34cf-4601-a593-ae4937d462dc HTTP/1.1" status: 204  len: 168 time: 0.6618476
May 26 14:58:06.432799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.435379 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:06.452326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:06.488750 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.501786 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.504721 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1fca8edc-a5bb-44ea-afe8-422771877bce req-b19bfa16-9ae2-4a56-a5df-e2d490f81ce3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 210 time: 0.0541260
May 26 14:58:06.509936 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9f273f3f-6a39-4772-9158-4c5b82ead3ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.522884 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fed43f83-3b90-40ae-9010-edbf43b81a9a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.537386 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:06.539486 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.540599 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fed43f83-3b90-40ae-9010-edbf43b81a9a HTTP/1.1" status: 204  len: 168 time: 0.5633810
May 26 14:58:06.541648 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 req-9ba672d1-8780-4434-a01e-2c57d4437ab1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:06.543402 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 req-9ba672d1-8780-4434-a01e-2c57d4437ab1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 944 time: 0.6512487
May 26 14:58:06.556523 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:06.567128 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.574291 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=837c6543-81e9-4a07-90ea-cad486d8bf26,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.593047 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.383s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:06.614829 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Allocated IP 172.20.0.3 (bc70d705-69d9-4bd7-ad11-798aa6a60676/71664cfa-bf05-4585-89e0-ac077a670be9/be847840-0dc2-4457-bb7b-594e083f4912) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:06.634539 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,segment=NetworkSegment(fc5f4185-4145-44ee-8d30-2fdc2c29ad21),segment_id=fc5f4185-4145-44ee-8d30-2fdc2c29ad21)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:06.642481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 req-a15e732e-ba17-4f61-bc53-ee06eef938fd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0740883
May 26 14:58:06.669866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.671264 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 4.2885091
May 26 14:58:06.754437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.761846 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-bced6914-bcd1-45aa-94e0-9b556fc8b484 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.772528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.32', 54814) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:06.787024 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.789505 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.799477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Made reservation on behalf of 81e8cac36a174b2eb5a6e53fdf25b4cc for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:06.803884 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.810089 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.823248 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e3986671-0a60-4056-a878-faa5b09ae71b,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.834527 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d4d0bb66c9e341c19ce1701e7de034b0&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0839140
May 26 14:58:06.835752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:06.841578 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dea77cad-5c47-4597-88c5-3c956ae4dd20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:06.883028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54804) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:06.914323 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6c42b67-62c1-43d0-9be6-9b43dc14a8c7,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.924326 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:06.933731 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:06.960261 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3ad98f86-7695-4a90-a3a5-34bc57a82cfb admin admin] 10.222.0.81 "DELETE /v2.0/subnets/c6c42b67-62c1-43d0-9be6-9b43dc14a8c7 HTTP/1.1" status: 204  len: 168 time: 2.0755477
May 26 14:58:06.964174 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54814) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:06.964802 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:06.972992 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:07.088867 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-06e1fb27-93f5-4ec4-be5a-5918423fce7c req-ff53c0c4-626e-44cc-bba4-4355c76bd451 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 210 time: 0.0598557
May 26 14:58:07.242692 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-f590bc03-a416-4dfc-8208-6b584ccf7c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:07.244434 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-f590bc03-a416-4dfc-8208-6b584ccf7c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 818 time: 0.4708598
May 26 14:58:07.247775 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.261911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Request body: {'port': {'device_id': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'admin_state_up': True, 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:07.296970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.311832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Allocated IP 172.20.0.6 (9a6b2b45-d448-425b-9716-75ffabad6539/455a1c06-d094-4995-9b7a-561be9ec484c/5b77d4a0-1161-49af-829e-9c8b577a215a) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:07.369937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.443772 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-bb134301-1750-4fa4-bafe-def4598b79db req-42fb6447-aff9-4bef-b2d1-ea74e2808909 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:07.485843 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.507941 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:07.570824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54840) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:07.586912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:07.597279 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.610864 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.627707 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7fcac4033880>> segment before_delete 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7fcac4033880>> subnet precommit_delete_associations 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> segment_host_mapping after_create 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> port after_create 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> port after_delete 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> port after_update 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> segment after_delete 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> subnet after_create 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> subnet after_delete 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.631899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7fcac42824f0>> subnet after_update 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.679384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.704387 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac438a850>> subnet after_create 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.705038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac438a850>> subnet after_delete 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.705038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac438a850>> subnet before_create 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.705370 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7fcac438a850>> subnet before_update 55550000 {{(pid=103981) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 26 14:58:07.706349 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4d08cd0>,) {'filters': {'network_id': ['e4ad6b8e-994d-46c5-a542-0429b253ad09']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:07.712442 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Made reservation on behalf of 0ad2ab2705ca479ab4aaafe7c80de162 for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:07.719056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.725346 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-bb134301-1750-4fa4-bafe-def4598b79db req-42fb6447-aff9-4bef-b2d1-ea74e2808909 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:07.725864 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-42fb6447-aff9-4bef-b2d1-ea74e2808909 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1352716442&fields=id&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 267 time: 0.4676266
May 26 14:58:07.730016 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:07.733066 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4d08cd0>, 'e2049b10-19df-4bc0-9b62-0782ed0807dc') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:07.733362 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4d08cd0>, 'e2049b10-19df-4bc0-9b62-0782ed0807dc') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:07.747054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Usage tracker for resource:security_group_rule and tenant:7699db943d024e30bb6c3e72b3788abe is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:07.750929 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:07.757735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.769355 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:07.779678 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1', 'code': 200}
May 26 14:58:07.845946 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54848) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:07.873282 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Transition to ACTIVE for port object 5b77d4a0-1161-49af-829e-9c8b577a215a will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:07.884126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.910488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:07.915181 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Usage tracker for resource:security_group_rule and tenant:d7b00571e2504aae86c8b7f2f38ae3f9 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:07.922482 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:07.961295 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:07.967349 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.969652 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:07.979234 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-062ef03a-d73a-4510-b145-9c60a8bfb8ff req-09152c92-c2af-4585-b7fb-514ce102b769 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 210 time: 0.0607822
May 26 14:58:07.993654 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Releasing vlan 1233 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 14:58:07.994065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.008436 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-313130f7-81a4-40ba-a32d-81a46d2e9f14 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   from cryptography.utils import int_from_bytes
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   from cryptography.utils import int_from_bytes
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 14:58:08.017882 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 14:58:08.037740 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e3986671-0a60-4056-a878-faa5b09ae71b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.100399 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.133628 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.141928 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.143110 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e3986671-0a60-4056-a878-faa5b09ae71b HTTP/1.1" status: 204  len: 168 time: 1.2533665
May 26 14:58:08.169422 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.180667 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.203256 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.216838 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.32', 54817) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:08.249579 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-f8e844bc-ea4f-4c00-a958-0b35c4902b83 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:08.250023 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-bb134301-1750-4fa4-bafe-def4598b79db req-f8e844bc-ea4f-4c00-a958-0b35c4902b83 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:network {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:08.262144 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.311637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:08.320019 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:08.320519 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.324927 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:08.330063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:08.343866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:08.358758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:08.363967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Allocated IP 172.20.0.10 (bc70d705-69d9-4bd7-ad11-798aa6a60676/71664cfa-bf05-4585-89e0-ac077a670be9/0cdf2872-b922-4d87-8260-bb3c5b2a449b) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:08.376041 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.387642 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.391423 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.407066 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.418709 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Pushing event updated for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.436496 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.445991 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.446498 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.036s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.484205 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Pushing event deleted for resources: {'Network': ['ID=e4ad6b8e-994d-46c5-a542-0429b253ad09,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.490488 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.496634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.500362 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-16ddbdf5-9e2c-40e3-96f7-7a69ece8549e admin admin] 10.222.0.81 "DELETE /v2.0/networks/e4ad6b8e-994d-46c5-a542-0429b253ad09 HTTP/1.1" status: 204  len: 168 time: 1.5299373
May 26 14:58:08.507882 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:08.508546 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.522015 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-bb134301-1750-4fa4-bafe-def4598b79db req-f8e844bc-ea4f-4c00-a958-0b35c4902b83 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:network {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:08.523046 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-f8e844bc-ea4f-4c00-a958-0b35c4902b83 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 817 time: 0.7780240
May 26 14:58:08.530313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:08.530944 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.543045 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d7b00571e2504aae86c8b7f2f38ae3f9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6955543
May 26 14:58:08.543961 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4e47860d-905e-4a4c-9565-997802a2f240,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.546240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54860) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:08.547912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.563379 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84369dfe-ea88-46d5-baf4-106505695eb8 req-4b0867db-f8db-471c-94e9-1a94e9732b8e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:08.566067 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84369dfe-ea88-46d5-baf4-106505695eb8 req-4b0867db-f8db-471c-94e9-1a94e9732b8e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.4571929
May 26 14:58:08.572093 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-fa3ab61a-6e57-4318-bdf7-c47b79ce5576 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/quotas/7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 375 time: 0.0361958
May 26 14:58:08.588489 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.644051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-175cb590-e2f6-49bd-ab24-045dca2f6c01 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:08.685105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6e3d5791-1eee-489d-bd75-6e2e592496c2 None None] Provisioning for port 5b77d4a0-1161-49af-829e-9c8b577a215a completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:08.690425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6e3d5791-1eee-489d-bd75-6e2e592496c2 None None] Provisioning complete for port 5b77d4a0-1161-49af-829e-9c8b577a215a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:08.695392 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6e3d5791-1eee-489d-bd75-6e2e592496c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.728965 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84369dfe-ea88-46d5-baf4-106505695eb8 req-4d529ea4-b52e-4c93-83a3-a0635ba3132e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1567674
May 26 14:58:08.737623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-3efb9a92-6105-45c4-b348-cdce106cdaa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:08.739964 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-3efb9a92-6105-45c4-b348-cdce106cdaa7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 1098 time: 0.5117106
May 26 14:58:08.754592 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.7951207
May 26 14:58:08.761847 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=7699db943d024e30bb6c3e72b3788abe&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1897385
May 26 14:58:08.774246 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54870) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:08.778779 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-6e3d5791-1eee-489d-bd75-6e2e592496c2 None None] Port 5b77d4a0-1161-49af-829e-9c8b577a215a cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:58:08.795651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df6779cd-adf8-4f72-8af6-deaa90bfe72c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:08.802714 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Request body: {'port': {'device_id': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:08.827100 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.6525133
May 26 14:58:08.855718 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:08.858445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Request body: {'port': {'device_id': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:08.876125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.905017 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:08.936490 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:08.950331 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-378101de-4be4-4250-a135-c6deded6ff72 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3485074
May 26 14:58:08.961075 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Usage tracker for resource:security_group_rule and tenant:1aed432d617e4ea48051c0308617584b is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:08.996201 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:09.030276 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:09.094014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 54882) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:09.107193 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.107736 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.191199 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.222548 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.267590 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-ec85e59c-15b6-43c7-be81-5ed917561cd5 service neutron] 10.222.0.81 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2681897
May 26 14:58:09.284329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.307396 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.358329 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-75b29b19-0cfc-46f0-8a4b-fc1dd3fa364f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5ca31a044ec5469880d1d95abddf0c2a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2654436
May 26 14:58:09.372382 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54890) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:09.417365 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a6d0a1d-87c0-439e-a802-772c1fa1691d req-af023d22-6cad-4193-a51a-9f48e5f57cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:09.420033 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-8a6d0a1d-87c0-439e-a802-772c1fa1691d req-af023d22-6cad-4193-a51a-9f48e5f57cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:09.514891 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.526574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-8a6d0a1d-87c0-439e-a802-772c1fa1691d req-af023d22-6cad-4193-a51a-9f48e5f57cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:09.529988 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8a6d0a1d-87c0-439e-a802-772c1fa1691d req-af023d22-6cad-4193-a51a-9f48e5f57cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 931 time: 0.5853286
May 26 14:58:09.537735 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.541393 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:09.586248 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7a155e1d-76e1-4a57-b60a-26199f00f100 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:09.591666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.609041 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e47860d-905e-4a4c-9565-997802a2f240,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:09.639009 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.642362 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:09.695861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-2da66fdb-38f2-4e7b-a6d3-ecb65bdf7060 service neutron] 10.222.0.81 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4185939
May 26 14:58:09.710998 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.712618 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.723735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-069abbc1-3456-4ce1-94bf-32af17442112 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:09.734746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Network bc70d705-69d9-4bd7-ad11-798aa6a60676 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:09.735059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.736355 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4e47860d-905e-4a4c-9565-997802a2f240 HTTP/1.1" status: 204  len: 168 time: 1.1893046
May 26 14:58:09.742889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:09.757690 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:09.805592 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8a6d0a1d-87c0-439e-a802-772c1fa1691d req-50db6235-a428-4e74-a72f-d083a6d416ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2570088
May 26 14:58:09.811994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Synchronizing usage tracker for tenant:1aed432d617e4ea48051c0308617584b on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:09.813902 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Pushing event updated for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:09.836300 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.250s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:09.837060 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.116s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:09.844523 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.845809 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/df6779cd-adf8-4f72-8af6-deaa90bfe72c HTTP/1.1" status: 204  len: 168 time: 1.0696561
May 26 14:58:09.852509 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:09.860132 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=bc56ad18-e353-4731-9b9c-2245efb73f52,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:09.863653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df6779cd-adf8-4f72-8af6-deaa90bfe72c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:09.872381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:09.881954 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:09.907895 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:09.909521 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.019142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be847840-0dc2-4457-bb7b-594e083f4912 {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:10.026706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.045658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5b77d4a0-1161-49af-829e-9c8b577a215a {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:10.062817 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.096814 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Unset dirty status for tenant:1aed432d617e4ea48051c0308617584b on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:10.098407 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fbf145b-acc7-46b0-9ad1-a82c7e359e27 req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.3406382
May 26 14:58:10.102287 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.8446906
May 26 14:58:10.114428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650cf999-c855-4d51-a26f-81f2d73e379d req-7183e10f-84e7-43bd-ad29-a7d5a6f46ca0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:10.115419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-650cf999-c855-4d51-a26f-81f2d73e379d req-7183e10f-84e7-43bd-ad29-a7d5a6f46ca0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:10.146612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Transition to ACTIVE for port object 5b77d4a0-1161-49af-829e-9c8b577a215a will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:10.196095 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Request body: {'port': {'device_id': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:10.259127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-650cf999-c855-4d51-a26f-81f2d73e379d req-7183e10f-84e7-43bd-ad29-a7d5a6f46ca0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:10.268061 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-650cf999-c855-4d51-a26f-81f2d73e379d req-7183e10f-84e7-43bd-ad29-a7d5a6f46ca0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 932 time: 0.2814505
May 26 14:58:10.270537 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.278006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Transition to ACTIVE for port object be847840-0dc2-4457-bb7b-594e083f4912 will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:10.284067 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.292739 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:10.302856 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:10.307629 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bea2ed7-cb75-45b8-b8dd-a4f7bd1a0157,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:10.309954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:10.322542 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.323657 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4bea2ed7-cb75-45b8-b8dd-a4f7bd1a0157 HTTP/1.1" status: 204  len: 168 time: 0.9504654
May 26 14:58:10.356445 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 req-2610f962-3888-408c-954a-9f24eb655b5d tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:10.358345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 req-2610f962-3888-408c-954a-9f24eb655b5d tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.2181351
May 26 14:58:10.393135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.409482 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e9be3537-2fa1-496a-a3a7-f295c5f8a01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:10.491531 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 req-ecea3c67-ec10-4580-9d16-1ca1ecc4c9a5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1223617
May 26 14:58:10.542430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:10.626106 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-650cf999-c855-4d51-a26f-81f2d73e379d req-167536ba-3446-4c32-a847-aa76d3d6823e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3565569
May 26 14:58:10.697793 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Pushing event updated for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:10.705050 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d59ebc32-93de-45e2-86b2-3091d52b884e req-2333a004-ef84-4978-947f-c658e4ed8db3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 210 time: 0.1208193
May 26 14:58:10.706088 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:10.745965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Pushing event updated for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:10.779283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.476s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:10.869886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Attempting to bind port be847840-0dc2-4457-bb7b-594e083f4912 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:58:10.870690 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Attempting to bind port be847840-0dc2-4457-bb7b-594e083f4912 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:58:10.871035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Attempting to bind port be847840-0dc2-4457-bb7b-594e083f4912 on network bc70d705-69d9-4bd7-ad11-798aa6a60676 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:10.888980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Port be847840-0dc2-4457-bb7b-594e083f4912 on network bc70d705-69d9-4bd7-ad11-798aa6a60676 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:58:10.889222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Attempting to bind port be847840-0dc2-4457-bb7b-594e083f4912 on network bc70d705-69d9-4bd7-ad11-798aa6a60676 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:10.900407 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:58:10.900922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Checking segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:10.901317 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Bound using segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:58:10.901770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Bound port: be847840-0dc2-4457-bb7b-594e083f4912, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:58:10.902117 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.020346 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Attempting to bind port 5b77d4a0-1161-49af-829e-9c8b577a215a on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:58:11.020705 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Attempting to bind port 5b77d4a0-1161-49af-829e-9c8b577a215a by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:58:11.021058 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Attempting to bind port 5b77d4a0-1161-49af-829e-9c8b577a215a on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:11.038009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:11.038693 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=be847840-0dc2-4457-bb7b-594e083f4912,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:11.054828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Port 5b77d4a0-1161-49af-829e-9c8b577a215a on network 9a6b2b45-d448-425b-9716-75ffabad6539 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:58:11.055151 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Attempting to bind port 5b77d4a0-1161-49af-829e-9c8b577a215a on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:11.067405 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:58:11.067745 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Checking segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:11.068283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Bound using segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:58:11.068772 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Bound port: 5b77d4a0-1161-49af-829e-9c8b577a215a, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:58:11.069120 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.191288 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.196381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:11.241152 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b req-091508b9-6da7-432a-9b6a-25ddf736624a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:11.242735 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b req-091508b9-6da7-432a-9b6a-25ddf736624a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 943 time: 0.2719774
May 26 14:58:11.270293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:11.270293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.271572 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] 10.222.0.32 "PUT /v2.0/ports/be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 1093 time: 2.4837651
May 26 14:58:11.275177 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:11.298074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:11.322654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0cdf2872-b922-4d87-8260-bb3c5b2a449b {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:11.330018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Pushing event updated for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:11.330164 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:11.336908 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.337477 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912', 'status': 'completed', 'code': 200}
May 26 14:58:11.348376 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b req-37582a16-3d6e-4310-9366-e8add8d3715f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0914540
May 26 14:58:11.350037 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5b77d4a0-1161-49af-829e-9c8b577a215a,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:11.370322 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Transition to ACTIVE for port object 0cdf2872-b922-4d87-8260-bb3c5b2a449b will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:11.434821 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-a504f79b-bddd-4c8f-bfe1-130429a3b23d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:11.436264 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-a504f79b-bddd-4c8f-bfe1-130429a3b23d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1096 time: 0.0780680
May 26 14:58:11.471601 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.473266 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.478701 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:11.659416 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54958) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:11.692137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:11.692712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:11.694127 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] 10.222.0.32 "PUT /v2.0/ports/5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 1093 time: 2.8461878
May 26 14:58:11.711910 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:11.746472 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Pushing event updated for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:11.921921 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Pushing event updated for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:11.933973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.455s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:11.961303 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5bc7a48c-3be7-4dd1-b717-cfcadaf00add admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=cc851c128d044c649d7ef02a3a136954&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3004699
May 26 14:58:11.965160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-baa2bcd2-87c3-4299-8896-27fda746150c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:11.966606 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-baa2bcd2-87c3-4299-8896-27fda746150c service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&shared=False HTTP/1.1" status: 200  len: 920 time: 0.5201874
May 26 14:58:11.967064 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 54974) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:11.993862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.364s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:11.993862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.001s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:12.183415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Attempting to bind port 0cdf2872-b922-4d87-8260-bb3c5b2a449b on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:58:12.183757 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Attempting to bind port 0cdf2872-b922-4d87-8260-bb3c5b2a449b by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:58:12.183973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Attempting to bind port 0cdf2872-b922-4d87-8260-bb3c5b2a449b on network bc70d705-69d9-4bd7-ad11-798aa6a60676 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:12.195010 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Port 0cdf2872-b922-4d87-8260-bb3c5b2a449b on network bc70d705-69d9-4bd7-ad11-798aa6a60676 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:58:12.195498 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Attempting to bind port 0cdf2872-b922-4d87-8260-bb3c5b2a449b on network bc70d705-69d9-4bd7-ad11-798aa6a60676 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:12.211630 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:58:12.211971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Checking segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:12.212366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Bound using segment: {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:58:12.212812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Bound port: 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:58:12.213157 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.238749 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea req-a12c0ee3-4dd4-4cdd-99d6-cb2335fc1bc6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.240327 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea req-a12c0ee3-4dd4-4cdd-99d6-cb2335fc1bc6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 944 time: 0.4083543
May 26 14:58:12.245962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-dbce8262-db7b-4297-b01b-ef97fd5a4acd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.251023 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-dbce8262-db7b-4297-b01b-ef97fd5a4acd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1096 time: 0.2545393
May 26 14:58:12.337244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d66510-9165-4564-aec9-fad5a3b43c2e req-5ebf92cf-b415-4b57-a792-662b7543a431 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.338803 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-48d66510-9165-4564-aec9-fad5a3b43c2e req-5ebf92cf-b415-4b57-a792-662b7543a431 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.6300609
May 26 14:58:12.343315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-405260e7-4fae-4a2c-a94e-80e377e8019e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.344692 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-405260e7-4fae-4a2c-a94e-80e377e8019e service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.3614392
May 26 14:58:12.396850 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.406391 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-516422fd-f007-422b-ad27-a6226a099958 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 217 time: 0.1199429
May 26 14:58:12.506016 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-54713cd7-3776-454b-86b7-da4b85720d66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.507453 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-54713cd7-3776-454b-86b7-da4b85720d66 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.0833657
May 26 14:58:12.521221 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea req-4247e31f-41eb-4f6a-b5da-07effe6d17f5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2655561
May 26 14:58:12.529513 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.539530 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-48d66510-9165-4564-aec9-fad5a3b43c2e req-f7494061-ac0d-44f0-adfd-463f87bd5307 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1436496
May 26 14:58:12.582031 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-b62542c8-ae81-4e18-a0c5-abab1299d2d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.583640 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-b62542c8-ae81-4e18-a0c5-abab1299d2d8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1096 time: 0.1889713
May 26 14:58:12.632059 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:12.677216 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:12.685199 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-d6841ea9-304c-454c-830f-0b179d10716e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.0929127
May 26 14:58:12.714519 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71688600-71ce-415f-a430-2c511ffc3fe8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.715906 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-71688600-71ce-415f-a430-2c511ffc3fe8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1935554
May 26 14:58:12.762783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-212e0eac-eb8a-409b-8141-829ed6912ddd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:12.764456 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-212e0eac-eb8a-409b-8141-829ed6912ddd service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.0711884
May 26 14:58:12.774190 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.800895 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b req-8edb57df-a95c-40ce-afe8-80893bc888dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:12.808239 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:12.835533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.845187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-853e2af2-fc57-40da-8551-c3a600c9cc62 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:12.857320 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-a290cd28-64b8-4287-90ec-eb54c5f2d271 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0849445
May 26 14:58:12.860598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5addf094-223c-49cc-8781-11667e517c5b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:12.904886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:12.956810 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'status': 'completed', 'code': 200}
May 26 14:58:12.961964 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:12.968480 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5addf094-223c-49cc-8781-11667e517c5b HTTP/1.1" status: 204  len: 168 time: 0.9945269
May 26 14:58:12.968732 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Pushing event updated for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:13.047163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:13.048368 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.048986 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:13.050981 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] 10.222.0.32 "PUT /v2.0/ports/0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 200  len: 1094 time: 2.8594658
May 26 14:58:13.119709 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-f22899b3-52a0-4b3c-93e3-8f99ddee6b57 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3704202
May 26 14:58:13.200594 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b req-8edb57df-a95c-40ce-afe8-80893bc888dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:13.210294 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b req-8edb57df-a95c-40ce-afe8-80893bc888dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 210 time: 0.4999149
May 26 14:58:13.340599 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-c5b1f854-d047-42e7-a786-0225c379eddb service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4745815
May 26 14:58:13.355304 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92ab111-5698-4dc4-8944-4ffb831270e7 req-3573318d-baf4-4ff3-a9cb-067fbf8350ce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.363350 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c92ab111-5698-4dc4-8944-4ffb831270e7 req-3573318d-baf4-4ff3-a9cb-067fbf8350ce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 943 time: 0.3116524
May 26 14:58:13.431200 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-99eb3d80-93f5-403d-8d3a-ced3045ef46b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.433389 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-99eb3d80-93f5-403d-8d3a-ced3045ef46b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 817 time: 0.2784288
May 26 14:58:13.435821 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db86aa9e-7286-4470-90df-9a25f76b8bf2 req-57bdd800-16b6-4b99-99c2-534b79451ca3 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3048368
May 26 14:58:13.496592 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-c37d2a69-f4de-4e2c-8b83-32ccef2d545f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.498252 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-c37d2a69-f4de-4e2c-8b83-32ccef2d545f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1097 time: 0.2639730
May 26 14:58:13.532326 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-41b008cf-22b1-474d-9323-b92039768dee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 380 time: 0.0848355
May 26 14:58:13.542860 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'port': {'device_id': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'admin_state_up': True, 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'security_groups': ['1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be']}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:13.608960 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-10eed1b2-6ee5-4b1b-9603-fbe57c07f4b9 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 200  len: 217 time: 0.0918462
May 26 14:58:13.613798 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c92ab111-5698-4dc4-8944-4ffb831270e7 req-98398240-fc61-4846-90cc-94925309b930 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2037110
May 26 14:58:13.745345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-277f5338-a806-4671-80af-28347f5bc3e2 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3785028
May 26 14:58:13.762381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-99086109-32a2-42ce-9a7c-6585bf730c7a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.763860 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-99086109-32a2-42ce-9a7c-6585bf730c7a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.1474817
May 26 14:58:13.814212 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-7e2173b3-edfb-464a-b6a1-885fd7e4b26b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0439265
May 26 14:58:13.873869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:13.912799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:13.973868 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-31cf3c46-71d7-4c15-a46e-8e667d7f8398 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.975367 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-31cf3c46-71d7-4c15-a46e-8e667d7f8398 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1096 time: 0.2746286
May 26 14:58:13.984206 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 req-40f030fe-f35b-4de4-a2c0-b2f3e080b5cf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:13.991647 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 req-40f030fe-f35b-4de4-a2c0-b2f3e080b5cf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 944 time: 0.2897182
May 26 14:58:14.067649 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68882a87-5409-4e59-acc8-f7afe5c6dd6a req-60ed2045-f2cf-4aa9-a947-18e1f7511d5c tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:14.069104 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68882a87-5409-4e59-acc8-f7afe5c6dd6a req-60ed2045-f2cf-4aa9-a947-18e1f7511d5c tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.2213187
May 26 14:58:14.071002 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-f6c68ed6-385d-4013-b86e-1d3b6b28df3d service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2487299
May 26 14:58:14.105283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Made reservation on behalf of 7555f6895a2a405685d8ccfe81fe5a74 for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:14.108699 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:14.136278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 req-ba0bdfae-4822-47c4-8122-9c64eb59b985 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1437545
May 26 14:58:14.198282 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68882a87-5409-4e59-acc8-f7afe5c6dd6a req-dcd00f5b-cbaf-43b4-9c75-e5e3d87ec88b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1228960
May 26 14:58:14.285700 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f req-83062a3e-bc34-4a5b-954a-61d37891b53c service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1959820
May 26 14:58:14.342355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-8f36d7ba-fe26-4308-bb5b-618a2d6c1d5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:14.343872 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-8f36d7ba-fe26-4308-bb5b-618a2d6c1d5a service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.3369603
May 26 14:58:14.434991 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Allocated IP 172.20.0.10 (c010dc4d-023b-4979-a482-d3b3e0924e91/09a19960-7788-4d46-a08e-92c63f201983/e948d481-711f-45b8-8deb-08b7658709e7) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:14.472730 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-d76f87ee-2c16-4b83-8ed6-d9cc84ac2735 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 217 time: 0.1141791
May 26 14:58:14.529042 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf416b53-fab0-47ed-add4-498decacd6f1 req-f989ff9e-1278-44c1-ab5b-0ed94f618510 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 210 time: 0.1055841
May 26 14:58:14.599200 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-8636d975-04c9-4f5b-b5d8-085302998df6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:14.600572 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-8636d975-04c9-4f5b-b5d8-085302998df6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.1197052
May 26 14:58:14.809063 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-2e51edbe-6e09-4205-a7d1-a438ab4bb18d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:14.810560 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-2e51edbe-6e09-4205-a7d1-a438ab4bb18d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1937938
May 26 14:58:14.815327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:14.871663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c58818-1c8b-44bb-98fb-447f83ce43bb req-4f360269-1b87-4f42-afb4-e358713abf5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:14.873123 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-37c58818-1c8b-44bb-98fb-447f83ce43bb req-4f360269-1b87-4f42-afb4-e358713abf5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 943 time: 0.1112821
May 26 14:58:14.908141 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Transition to ACTIVE for port object e948d481-711f-45b8-8deb-08b7658709e7 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:14.923229 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-37c58818-1c8b-44bb-98fb-447f83ce43bb req-ce111a28-cfdd-4d73-bc15-959c77029fa8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427933
May 26 14:58:14.961014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:14.977209 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-1d52edbc-6348-4c57-b744-69a6f5ecaaa4 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1585097
May 26 14:58:15.105402 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b', 'status': 'completed', 'code': 200}
May 26 14:58:15.112531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:15.136803 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4b9856a6-8b12-47c7-b493-adac875719d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:15.138349 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-8bee5c5c-0e0a-4326-b2e7-4205927cd74c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:15.141073 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-8bee5c5c-0e0a-4326-b2e7-4205927cd74c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1097 time: 0.0877602
May 26 14:58:15.235719 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:15.264365 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:15.276929 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:15.358324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:15.368044 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:15.422832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:15.423468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:15.430374 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-c9bb4395-3d3c-493f-9ceb-66191536ba87 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4452200
May 26 14:58:15.460621 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-4d975636-5812-4a99-8f07-0c3f732bc51f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:15.469861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-4d975636-5812-4a99-8f07-0c3f732bc51f service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.3145869
May 26 14:58:15.553082 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.0155842
May 26 14:58:15.553820 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-21286c04-9b0a-419a-8ce4-b6f79e1e1ae0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 200  len: 217 time: 0.0828576
May 26 14:58:15.574142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Request body: {'port': {'device_id': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:15.729049 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-d4845154-08b4-4762-b75e-45098069514a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:15.729049 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-d4845154-08b4-4762-b75e-45098069514a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:15.748283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-d4845154-08b4-4762-b75e-45098069514a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:15.757704 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-d4845154-08b4-4762-b75e-45098069514a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 944 time: 0.1993849
May 26 14:58:15.757849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6c076114-85fd-4a22-9061-a1a52fda4c8b None None] Provisioning for port e948d481-711f-45b8-8deb-08b7658709e7 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:15.760355 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-1ba07305-22f9-49af-a8ce-1a4b36fb6ebf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:15.761861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-1ba07305-22f9-49af-a8ce-1a4b36fb6ebf service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.1416070
May 26 14:58:15.763551 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6c076114-85fd-4a22-9061-a1a52fda4c8b None None] Provisioning complete for port e948d481-711f-45b8-8deb-08b7658709e7 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:15.764081 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6c076114-85fd-4a22-9061-a1a52fda4c8b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:15.819303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:15.822994 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-6c076114-85fd-4a22-9061-a1a52fda4c8b None None] Port e948d481-711f-45b8-8deb-08b7658709e7 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:58:15.884295 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-3f917f96-921d-450d-ba7a-62dbc2c685d2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0804155
May 26 14:58:15.915279 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-822acc62-adb3-430b-90f3-0bd4a115d552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:16.047325 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5b77d4a0-1161-49af-829e-9c8b577a215a details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:16.271508 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-0def7df9-dd0e-4d65-82a8-80f47ed67ce3 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3587101
May 26 14:58:16.272077 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cabf466c-0511-49b2-bd16-fddca5014c23 req-5bb5ea04-c712-4b78-80e0-6a54ac91a1a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:16.272684 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-cabf466c-0511-49b2-bd16-fddca5014c23 req-5bb5ea04-c712-4b78-80e0-6a54ac91a1a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:16.304399 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5b77d4a0-1161-49af-829e-9c8b577a215a,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:16.321140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'port_id': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'mac_address': 'fa:16:3e:f5:55:91', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1230, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:16.391429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:16.414739 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5b77d4a0-1161-49af-829e-9c8b577a215a {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:16.433420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5b77d4a0-1161-49af-829e-9c8b577a215a,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:16.439015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-cabf466c-0511-49b2-bd16-fddca5014c23 req-5bb5ea04-c712-4b78-80e0-6a54ac91a1a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:16.440741 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cabf466c-0511-49b2-bd16-fddca5014c23 req-5bb5ea04-c712-4b78-80e0-6a54ac91a1a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 932 time: 0.6958218
May 26 14:58:16.453014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:16.454925 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-822acc62-adb3-430b-90f3-0bd4a115d552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:16.469849 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 req-822acc62-adb3-430b-90f3-0bd4a115d552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6999261
May 26 14:58:16.509364 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:16.510162 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device be847840-0dc2-4457-bb7b-594e083f4912 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:16.512762 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:16.543828 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cabf466c-0511-49b2-bd16-fddca5014c23 req-fc8020f8-9695-4964-b0d6-fdcf15dcd98d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0936301
May 26 14:58:16.557891 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-47147e49-d19b-4ccb-9d69-c4a36d912c7c service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2716060
May 26 14:58:16.561612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Transition to ACTIVE for port object e948d481-711f-45b8-8deb-08b7658709e7 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:16.643642 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:16.648903 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:16.672236 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:16.729629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:16.734798 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:16.749343 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:16.754013 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:16.766534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 req-bf238806-3444-4dae-9011-78174836b87d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:16.772166 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 req-bf238806-3444-4dae-9011-78174836b87d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 944 time: 0.1559417
May 26 14:58:16.834129 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=be847840-0dc2-4457-bb7b-594e083f4912,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:16.885101 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 req-55ce2ced-28a0-4b7d-a377-a01f2b382327 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1045451
May 26 14:58:16.888329 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'be847840-0dc2-4457-bb7b-594e083f4912', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'port_id': 'be847840-0dc2-4457-bb7b-594e083f4912', 'mac_address': 'fa:16:3e:c8:94:34', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:16.998419 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.021638 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be847840-0dc2-4457-bb7b-594e083f4912 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:17.029724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Attempting to bind port e948d481-711f-45b8-8deb-08b7658709e7 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:58:17.031737 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Attempting to bind port e948d481-711f-45b8-8deb-08b7658709e7 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:58:17.032084 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Attempting to bind port e948d481-711f-45b8-8deb-08b7658709e7 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:17.043325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Port e948d481-711f-45b8-8deb-08b7658709e7 on network c010dc4d-023b-4979-a482-d3b3e0924e91 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:58:17.043649 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Attempting to bind port e948d481-711f-45b8-8deb-08b7658709e7 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:17.048640 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=be847840-0dc2-4457-bb7b-594e083f4912,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:17.056228 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:58:17.056677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Checking segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:17.057234 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Bound using segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:58:17.057579 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Bound port: e948d481-711f-45b8-8deb-08b7658709e7, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:58:17.057992 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.124022 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.128727 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:17.175970 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:17.180024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:17.223788 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:17.226959 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:17.311062 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.333413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:17.381062 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['be847840-0dc2-4457-bb7b-594e083f4912'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:17.415687 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5b77d4a0-1161-49af-829e-9c8b577a215a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:17.441156 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:17.444715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:17.450814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:17.451432 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.453644 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] 10.222.0.32 "PUT /v2.0/ports/e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 1094 time: 1.8863518
May 26 14:58:17.454158 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:17.531146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'status': 'completed', 'code': 200}
May 26 14:58:17.552335 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55190) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:17.756490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-0a5ab49d-ddd2-41f0-974c-02f38d49f300 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:17.762646 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-0a5ab49d-ddd2-41f0-974c-02f38d49f300 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1097 time: 0.1978047
May 26 14:58:17.780002 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:17.865186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:17.874212 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Usage tracker for resource:security_group_rule and tenant:0c531364be6143acb4024ef83a630284 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:17.878766 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:17.886355 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:17.922849 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9999a3c-001f-41ec-9809-686aece14d17 req-fc503e44-cb91-4bc4-8aea-ea6a4c417488 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:17.925047 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f9999a3c-001f-41ec-9809-686aece14d17 req-fc503e44-cb91-4bc4-8aea-ea6a4c417488 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 944 time: 0.1180882
May 26 14:58:17.942106 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-fd1e7529-407a-4f39-a22c-3be0cf47e143 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:17.943565 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-fd1e7529-407a-4f39-a22c-3be0cf47e143 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&shared=False HTTP/1.1" status: 200  len: 919 time: 0.1727045
May 26 14:58:17.984588 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f9999a3c-001f-41ec-9809-686aece14d17 req-96b67fcb-7aa0-43ac-86ff-335596ae0fb7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0529461
May 26 14:58:18.029313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.062449 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 0cdf2872-b922-4d87-8260-bb3c5b2a449b details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:18.119109 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-bf83cdb2-28aa-4c11-9cb6-66e1a18d4db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.120569 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-bf83cdb2-28aa-4c11-9cb6-66e1a18d4db1 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1618478
May 26 14:58:18.146296 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.159977 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d59a208f-b2af-439e-a3a1-534f54dfc1ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:18.211539 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0c531364be6143acb4024ef83a630284&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6580060
May 26 14:58:18.214973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55210) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:18.218814 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43c93157-9162-4a70-a440-e45c3a94f610,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:18.223482 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:18.257294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3acb08e4-7509-40e7-815b-daaf63eac52d req-b5ce0f54-7459-423a-af2b-b150b93d304a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.258811 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3acb08e4-7509-40e7-815b-daaf63eac52d req-b5ce0f54-7459-423a-af2b-b150b93d304a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1591687
May 26 14:58:18.264086 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:18.281006 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '0cdf2872-b922-4d87-8260-bb3c5b2a449b', 'network_id': 'bc70d705-69d9-4bd7-ad11-798aa6a60676', 'port_id': '0cdf2872-b922-4d87-8260-bb3c5b2a449b', 'mac_address': 'fa:16:3e:14:ca:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '71664cfa-bf05-4585-89e0-ac077a670be9', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:18.312468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-58548dd8-51c4-48a4-a388-76d5a7b02695 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.314049 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-58548dd8-51c4-48a4-a388-76d5a7b02695 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1097 time: 0.1472380
May 26 14:58:18.318738 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55214) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:18.319427 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.327810 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3acb08e4-7509-40e7-815b-daaf63eac52d req-63222c2c-6e26-482f-b918-aaf293597b4e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0611947
May 26 14:58:18.359103 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.387529 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0cdf2872-b922-4d87-8260-bb3c5b2a449b {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:18.404396 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:18.417929 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-0dd773fc-75a6-4cfa-b92c-b13f2233e1be service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 217 time: 0.0871487
May 26 14:58:18.428035 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.495350 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.497152 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:18.535597 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-9da03f35-0590-4e07-ac80-2d997ce36344 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.537798 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-9da03f35-0590-4e07-ac80-2d997ce36344 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.1136875
May 26 14:58:18.560254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 req-70244fe5-831b-4259-87ef-4298130397c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.561965 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 req-70244fe5-831b-4259-87ef-4298130397c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 944 time: 0.1268306
May 26 14:58:18.632819 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:18.646505 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:18.656241 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 req-5609e8bc-a4a0-433a-bb4b-d0825e3eb4a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0877359
May 26 14:58:18.678196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.698892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.712152 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-70b8823f-c422-42a2-8663-55f0dd5e66e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:18.725056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43c93157-9162-4a70-a440-e45c3a94f610,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:18.736363 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:18.743806 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:18.746947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:18.748054 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/43c93157-9162-4a70-a440-e45c3a94f610 HTTP/1.1" status: 204  len: 168 time: 0.5321681
May 26 14:58:18.751668 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Usage tracker for resource:security_group_rule and tenant:c19a71d3e17640c78de7e69d94477f12 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:18.754114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['0cdf2872-b922-4d87-8260-bb3c5b2a449b'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:18.756680 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:18.776474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:18.818683 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb134301-1750-4fa4-bafe-def4598b79db req-2eb8999b-833f-46b3-b4b0-1407c988f611 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:18.820272 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-2eb8999b-833f-46b3-b4b0-1407c988f611 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2390420
May 26 14:58:19.046115 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-5f43ed81-e479-439e-a7a7-a88a146ea6fe service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2172163
May 26 14:58:19.207114 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.262765 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bb134301-1750-4fa4-bafe-def4598b79db req-881cb38c-c6fe-467e-b1d1-c3d2ad22b9ed service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2094526
May 26 14:58:19.281660 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675342dd-5645-426f-934d-f11fa9b21175 req-9523bda2-5ef6-4025-bfb4-439c7b79cb19 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:19.289118 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-675342dd-5645-426f-934d-f11fa9b21175 req-9523bda2-5ef6-4025-bfb4-439c7b79cb19 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 945 time: 0.1545777
May 26 14:58:19.308892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.319989 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-52b2d071-ac74-41ea-821f-fb7ff1d76af3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:19.373870 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-675342dd-5645-426f-934d-f11fa9b21175 req-193d21a4-3247-43a1-873a-9886b02a1a07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0838239
May 26 14:58:19.379942 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c19a71d3e17640c78de7e69d94477f12&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0575395
May 26 14:58:19.381683 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0255302f-c5fb-44d3-b572-532915177eb4,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:19.382860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55246) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:19.385038 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:19.560373 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.601940 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.659966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55256) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:19.668923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 req-5f67bb9d-afc3-44b7-a5d5-16f2518f60ea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:19.671527 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 req-5f67bb9d-afc3-44b7-a5d5-16f2518f60ea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1871028
May 26 14:58:19.706037 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.743194 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:19.750826 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Usage tracker for resource:security_group_rule and tenant:e22c069c798d489ba04244a34a33195d is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:19.758520 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:19.773658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:19.774986 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 req-644136bf-eb99-4014-9e53-540603ac4d09 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0904589
May 26 14:58:19.826145 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.830221 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9de59f45-4440-4e12-b7bc-fb4b8624abfc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:19.848374 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0255302f-c5fb-44d3-b572-532915177eb4,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:19.848374 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:19.856148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:19.859731 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0255302f-c5fb-44d3-b572-532915177eb4 HTTP/1.1" status: 204  len: 168 time: 0.4735589
May 26 14:58:19.936971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 req-8e775889-5643-40e2-ad7d-4cf4a4c6b226 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:19.938462 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 req-8e775889-5643-40e2-ad7d-4cf4a4c6b226 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 944 time: 0.1579154
May 26 14:58:19.992523 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.004798 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 req-aec29bea-4ad8-46b9-88b1-bf641fb9031f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0551577
May 26 14:58:20.053038 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.061428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:20.101371 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e22c069c798d489ba04244a34a33195d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4382877
May 26 14:58:20.103143 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a99e83cd-47cc-4205-be1c-09cc6b58da0c,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:20.104217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55264) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:20.106089 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:20.167854 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.194450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.346051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.352118 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b449d9a9-b1b4-4ddd-a707-0e9c0102dd3c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:20.367117 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a99e83cd-47cc-4205-be1c-09cc6b58da0c,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:20.369783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:20.372340 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.373816 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a99e83cd-47cc-4205-be1c-09cc6b58da0c HTTP/1.1" status: 204  len: 168 time: 0.2683251
May 26 14:58:20.523909 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-15d33257-714e-4467-9b43-5bfde232194e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.577561 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e3cb79-e95f-4471-a778-c06020ab2a6b req-d1ad5e16-30eb-41d2-8cb2-f38a724407bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:20.579131 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f7e3cb79-e95f-4471-a778-c06020ab2a6b req-d1ad5e16-30eb-41d2-8cb2-f38a724407bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 945 time: 0.0934668
May 26 14:58:20.636213 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f7e3cb79-e95f-4471-a778-c06020ab2a6b req-41f5bfbf-9447-4e45-b960-09943f32898d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484107
May 26 14:58:20.709080 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55278) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:20.726520 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.740819 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:20.744623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Usage tracker for resource:security_group_rule and tenant:e6dc092ca71c44f4819ccf314814eda8 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:20.747464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:20.753651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:20.814316 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5b77d4a0-1161-49af-829e-9c8b577a215a up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:20.845867 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.963478 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:20.973450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5f92887e-38e8-4f58-9062-61a9f9955928 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:20.980922 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 5b77d4a0-1161-49af-829e-9c8b577a215a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:20.990104 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 5b77d4a0-1161-49af-829e-9c8b577a215a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:20.990679 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.026515 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e6dc092ca71c44f4819ccf314814eda8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3160613
May 26 14:58:21.032210 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d955214f-41b7-4c4b-b118-442d86b0dfaa,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:21.042166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55298) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:21.047480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:21.124894 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43db613f-afeb-4d3b-86c3-07eb3b1c157e req-d1fc06b3-0218-4a02-baed-3076325e1bb4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:21.135740 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43db613f-afeb-4d3b-86c3-07eb3b1c157e req-d1fc06b3-0218-4a02-baed-3076325e1bb4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.2346563
May 26 14:58:21.152096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.187564 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:21.197909 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5b77d4a0-1161-49af-829e-9c8b577a215a,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:21.199612 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43db613f-afeb-4d3b-86c3-07eb3b1c157e req-5b7a005b-7273-4971-a018-8d37bcc8d7ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0627487
May 26 14:58:21.222079 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.233249 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 req-4302144a-6104-409c-8e0d-fd32631b336c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:21.234846 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 req-4302144a-6104-409c-8e0d-fd32631b336c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 944 time: 0.1019337
May 26 14:58:21.245227 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.266977 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'code': 200}
May 26 14:58:21.288950 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.289868 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 0cdf2872-b922-4d87-8260-bb3c5b2a449b up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:21.291403 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 req-a24bc890-c1b0-4b12-a216-31ce6d523dba tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0490294
May 26 14:58:21.327190 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:21.374484 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.382714 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:21.399036 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d955214f-41b7-4c4b-b118-442d86b0dfaa,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:21.401782 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:21.412938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.414328 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/d955214f-41b7-4c4b-b118-442d86b0dfaa HTTP/1.1" status: 204  len: 168 time: 0.3709950
May 26 14:58:21.426879 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:21.431726 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:21.483340 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 0cdf2872-b922-4d87-8260-bb3c5b2a449b completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:21.489767 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 0cdf2872-b922-4d87-8260-bb3c5b2a449b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:21.490140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.613287 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.646273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:21.712514 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:21.713951 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device be847840-0dc2-4457-bb7b-594e083f4912 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:21.781175 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3e637250-82c5-4a0c-a7ad-a08ad917eadc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:21.860753 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c7dba8e-d872-47de-8d66-331eb856f6c3 req-50619fe7-2061-4049-aa6f-6661dd4e0a98 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:21.861275 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:21.863092 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3c7dba8e-d872-47de-8d66-331eb856f6c3 req-50619fe7-2061-4049-aa6f-6661dd4e0a98 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0923898
May 26 14:58:21.865901 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:21.914552 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3c7dba8e-d872-47de-8d66-331eb856f6c3 req-796f09c3-fda5-40ca-b4fc-1d235da350a5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442181
May 26 14:58:21.997566 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port be847840-0dc2-4457-bb7b-594e083f4912 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:22.002774 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port be847840-0dc2-4457-bb7b-594e083f4912 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:22.003154 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:22.131893 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:22.167229 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=be847840-0dc2-4457-bb7b-594e083f4912,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:22.312294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:22.314426 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:22.417989 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 req-b1d50f1b-7d9a-4ec6-bbef-08eef8bb9ec2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:22.421881 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 req-b1d50f1b-7d9a-4ec6-bbef-08eef8bb9ec2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1099372
May 26 14:58:22.443898 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:22.448467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:22.485912 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 req-908dd90e-e107-486e-9d90-28dfb5b05f78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0566957
May 26 14:58:22.536858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c2a625-6122-4ea1-ae90-db64949203d2 req-f53af628-1ee3-43cc-85ae-f7e7c439f625 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:22.538517 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c4c2a625-6122-4ea1-ae90-db64949203d2 req-f53af628-1ee3-43cc-85ae-f7e7c439f625 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0966041
May 26 14:58:22.584622 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c4c2a625-6122-4ea1-ae90-db64949203d2 req-1794daf9-c388-4d02-b868-b097a796d82e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396161
May 26 14:58:23.105439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2f3364-c1a4-41c9-adf9-856f802ae301 req-511f9169-6b11-449c-aec3-5f1fa95b9be4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.106928 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7c2f3364-c1a4-41c9-adf9-856f802ae301 req-511f9169-6b11-449c-aec3-5f1fa95b9be4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0840633
May 26 14:58:23.117575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:23.182244 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7c2f3364-c1a4-41c9-adf9-856f802ae301 req-59be4188-6ec4-4a0e-9d60-4cfced417752 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0692761
May 26 14:58:23.226506 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-16015704-47e1-4b52-889d-4dea80fe5039 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:23.236789 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49cd4098-417d-4c43-99e8-35a2cea78560 req-42a7bc74-0950-4ed0-8387-6cd976b9d886 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.238546 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-49cd4098-417d-4c43-99e8-35a2cea78560 req-42a7bc74-0950-4ed0-8387-6cd976b9d886 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1098 time: 0.0779157
May 26 14:58:23.268906 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b'}, {'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:23.282194 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-49cd4098-417d-4c43-99e8-35a2cea78560 req-7ff2ed5f-3834-44ec-a84e-a725ee8e19b0 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0368972
May 26 14:58:23.336394 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b', 'code': 200}
May 26 14:58:23.336916 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912', 'code': 200}
May 26 14:58:23.365875 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55386) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:23.501524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:23.526116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:23.535562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Usage tracker for resource:security_group_rule and tenant:63473b74c6bb4ceba00ff0ed7a296a5b is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:23.550553 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:23.557355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:23.681439 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:23.728350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f2b1b89-59ad-4729-83d0-f83793212ed9 req-910c54ff-e4ea-4793-b8c9-08b084e0ae14 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.732543 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9f2b1b89-59ad-4729-83d0-f83793212ed9 req-910c54ff-e4ea-4793-b8c9-08b084e0ae14 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1018789
May 26 14:58:23.794030 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:23.807942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:23.841997 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9f2b1b89-59ad-4729-83d0-f83793212ed9 req-571bdc5e-be9a-4eae-bd44-3e7694b54eba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0784569
May 26 14:58:23.858970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93fc0682-63c6-4e5a-83f3-162c200d3ebb req-22b60bd3-7844-4b24-8e77-e821b0f5db7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.860829 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93fc0682-63c6-4e5a-83f3-162c200d3ebb req-22b60bd3-7844-4b24-8e77-e821b0f5db7e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1099 time: 0.1273630
May 26 14:58:23.875936 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=63473b74c6bb4ceba00ff0ed7a296a5b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5090427
May 26 14:58:23.876743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d7ac786-8318-45c3-b55c-7dba6864c54d,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:23.881681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55404) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:23.884322 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:23.916157 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93fc0682-63c6-4e5a-83f3-162c200d3ebb req-11e51035-a2ed-4756-b34b-d94dfa6021fc service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0468011
May 26 14:58:23.953505 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6757ae51-f7b5-4a07-a218-9c0de832643e req-9ed9343c-1768-4792-a97e-b7cfcff21f46 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.955047 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6757ae51-f7b5-4a07-a218-9c0de832643e req-9ed9343c-1768-4792-a97e-b7cfcff21f46 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2122438
May 26 14:58:23.960045 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e70eda3f-1705-4160-b32e-1e8ee8bc2d3f req-022cea7e-5c78-450c-95b0-1056048fc60c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:23.961463 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e70eda3f-1705-4160-b32e-1e8ee8bc2d3f req-022cea7e-5c78-450c-95b0-1056048fc60c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.2637901
May 26 14:58:23.982102 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:24.070972 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:24.077338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:24.092338 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e70eda3f-1705-4160-b32e-1e8ee8bc2d3f req-cd6157a5-e151-4ff6-b8f9-a0acdb97dc95 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0955863
May 26 14:58:24.109041 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6757ae51-f7b5-4a07-a218-9c0de832643e req-ab13c61e-6936-4c10-9876-a0debd75b667 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1351683
May 26 14:58:24.270560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:24.275907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:24.295163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d7ac786-8318-45c3-b55c-7dba6864c54d,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:24.298051 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:24.299052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:24.301156 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8d7ac786-8318-45c3-b55c-7dba6864c54d HTTP/1.1" status: 204  len: 168 time: 0.4181225
May 26 14:58:24.449889 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-398c6330-763b-40de-bdda-513898bc655d req-ece922ba-2756-4384-8f9b-b7b92d87cb62 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:24.468021 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-398c6330-763b-40de-bdda-513898bc655d req-ece922ba-2756-4384-8f9b-b7b92d87cb62 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1796169
May 26 14:58:24.537678 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-398c6330-763b-40de-bdda-513898bc655d req-8f6448d6-2ac4-4ed9-abd0-ae4ea949adbf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0682056
May 26 14:58:25.072989 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2080b961-3161-424d-a0a7-cca40a855070 req-f6cb84d3-4b58-4437-9368-3a0621c1177d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:25.080082 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2080b961-3161-424d-a0a7-cca40a855070 req-f6cb84d3-4b58-4437-9368-3a0621c1177d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1163747
May 26 14:58:25.131863 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2080b961-3161-424d-a0a7-cca40a855070 req-69947214-4980-4dde-bece-ca797b8fa65f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0501411
May 26 14:58:25.214838 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55464) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:25.231609 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.371070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:25.376642 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Usage tracker for resource:security_group_rule and tenant:bc405f85e3044d8fa6d066cad6813619 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:25.385533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:25.394724 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:25.446672 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f405da1e-1627-410a-9f15-a59a74d4c203 req-383b361d-ce37-40b5-8328-9a01256d8b42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:25.448129 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f405da1e-1627-410a-9f15-a59a74d4c203 req-383b361d-ce37-40b5-8328-9a01256d8b42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1988299
May 26 14:58:25.525694 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f405da1e-1627-410a-9f15-a59a74d4c203 req-769d12fe-1ab4-47ce-9f3c-7b1ed48a7b26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0710256
May 26 14:58:25.542105 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.620222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.620469 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.655457 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:25.709305 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bc405f85e3044d8fa6d066cad6813619&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4957333
May 26 14:58:25.712528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55478) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:25.756111 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6485363a-1675-4358-9b4e-83ac339bfc42 req-e04aad22-2513-4434-b7ea-8751445c694c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:25.757894 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6485363a-1675-4358-9b4e-83ac339bfc42 req-e04aad22-2513-4434-b7ea-8751445c694c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1123216
May 26 14:58:25.762036 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbbac6d2-dcaa-4803-bec3-3f2ede15702b,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:25.776294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:25.780287 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55484) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:25.792455 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'floatingip': {'port_id': '5b77d4a0-1161-49af-829e-9c8b577a215a'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:25.800059 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.829420 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.880341 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 req-c7e4390a-4d4e-453a-bbce-807151e8a2fa tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:25.887134 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 req-c7e4390a-4d4e-453a-bbce-807151e8a2fa tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.2326112
May 26 14:58:25.891189 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:25.998633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:26.005302 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:26.050986 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 req-b6863e82-7e88-4b88-bbd5-4a63b70dce8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1629529
May 26 14:58:26.108378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbbac6d2-dcaa-4803-bec3-3f2ede15702b,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:26.119008 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:26.119622 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:26.121733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:26.123008 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fbbac6d2-dcaa-4803-bec3-3f2ede15702b HTTP/1.1" status: 204  len: 168 time: 0.4083235
May 26 14:58:26.401455 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:26.424352 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'e948d481-711f-45b8-8deb-08b7658709e7', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:26.487935 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:26.508305 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:26.525899 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:26.590682 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:26.592405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c7313cb8-2c2e-4b20-b445-3e2b22974278 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:26.730084 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b req-1fb85a45-8ea5-401d-bd64-684b246e6690 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:26.730084 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b req-1fb85a45-8ea5-401d-bd64-684b246e6690 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.3590522
May 26 14:58:26.770272 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:26.793079 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:26.881708 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b req-ae96a36c-4f6e-4676-882c-80d37ea971c2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1202154
May 26 14:58:26.922121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe req-f5a7822c-16f6-4c2c-bd42-5c171eb57fb4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:26.922121 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe req-f5a7822c-16f6-4c2c-bd42-5c171eb57fb4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1879964
May 26 14:58:26.950965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e948d481-711f-45b8-8deb-08b7658709e7'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:26.987425 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe req-9efe744d-6e3b-446e-a288-5a839d18dd05 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0582154
May 26 14:58:27.022241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-3135a5e3-6f34-41ec-bbaa-07d46042072e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:27.022241 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-3135a5e3-6f34-41ec-bbaa-07d46042072e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1099 time: 0.1322634
May 26 14:58:27.075719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:27.187012 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-56d0a2dc-cb3f-48b8-8905-073b4882e6a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:27.188464 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-56d0a2dc-cb3f-48b8-8905-073b4882e6a3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1750202
May 26 14:58:27.264539 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-99499893-c6aa-444c-aa1d-599e15c47b35 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 200  len: 217 time: 0.0679755
May 26 14:58:27.336470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-cad5054c-5d04-4eda-8c15-3d9731ba9d1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:27.337849 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-cad5054c-5d04-4eda-8c15-3d9731ba9d1d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.0569620
May 26 14:58:27.399396 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-558603f5-de49-44a1-8dff-65df12e64246 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0506494
May 26 14:58:27.550089 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-aad04990-a2b4-43da-8e12-21cd3b24371d service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1391046
May 26 14:58:27.637527 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:27.684025 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:27.693476 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eeca6dcc-3e79-48f0-a39b-e0947a470545 req-942df00a-4db8-467d-8b37-3436d962a35a service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1331186
May 26 14:58:27.920497 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Floating IP 3908a854-dbfa-4dc7-a191-1a903dc01b81 associated. External IP: 172.27.2.43, port: 5b77d4a0-1161-49af-829e-9c8b577a215a.
May 26 14:58:28.124274 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:58:28.217485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7a5535-6d1d-4936-8492-172f4d2b7733 req-92619de9-0b81-4a77-91fe-d139415203bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:28.219750 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5b7a5535-6d1d-4936-8492-172f4d2b7733 req-92619de9-0b81-4a77-91fe-d139415203bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1026165
May 26 14:58:28.237926 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a48c949-a7f4-4344-aed4-5758769c72c4 req-5404291f-305e-4e76-9373-cdce34130c08 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:28.239413 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4a48c949-a7f4-4344-aed4-5758769c72c4 req-5404291f-305e-4e76-9373-cdce34130c08 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.2445478
May 26 14:58:28.288020 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5b7a5535-6d1d-4936-8492-172f4d2b7733 req-b2bc1c99-6f34-4ab0-bf8f-908e4f934a95 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0556769
May 26 14:58:28.300394 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port e948d481-711f-45b8-8deb-08b7658709e7 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:58:28.305330 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port e948d481-711f-45b8-8deb-08b7658709e7 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:58:28.305940 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:28.371078 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4a48c949-a7f4-4344-aed4-5758769c72c4 req-39311ad4-cf96-4caa-9cd6-3c2ad471be77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1230431
May 26 14:58:28.410799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:58:28.476558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:28.504676 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:28.516552 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:28.552776 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'code': 200}
May 26 14:58:28.588700 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:28.591795 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:28.617176 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:58:28.631639 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:58:28.642297 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:58:28.644026 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5a91700>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:58:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:28.653005 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:28.675705 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:28.679367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:28.729987 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5a27cdda-8e94-4e9e-8d70-21668229e857 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "PUT /v2.0/floatingips/3908a854-dbfa-4dc7-a191-1a903dc01b81 HTTP/1.1" status: 200  len: 990 time: 2.9447796
May 26 14:58:28.729987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:28.809120 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'status': 'completed', 'code': 200}
May 26 14:58:28.898963 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:58:28.930262 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-8b4e7d44-7897-48a7-8476-b9244dd4331a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:28.930262 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-8b4e7d44-7897-48a7-8476-b9244dd4331a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1098 time: 0.0917878
May 26 14:58:29.109170 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a66ed7-6e2b-4e55-aee3-79ff7b59b3c3 req-49267de5-b4be-4487-8feb-90a1f959b4b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.111070 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-99a66ed7-6e2b-4e55-aee3-79ff7b59b3c3 req-49267de5-b4be-4487-8feb-90a1f959b4b0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1099 time: 0.1482174
May 26 14:58:29.194618 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-52bb94f2-0ac6-4861-b9a4-b590d7b969c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.196907 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-52bb94f2-0ac6-4861-b9a4-b590d7b969c5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.2565465
May 26 14:58:29.219613 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-99a66ed7-6e2b-4e55-aee3-79ff7b59b3c3 req-a2fc753d-0c79-43ff-bf63-d4ce8d837517 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0911551
May 26 14:58:29.330969 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-723de313-b017-418b-9e59-fe73fb732d8d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 998 time: 0.1225910
May 26 14:58:29.400792 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5a91700>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '3908a854-dbfa-4dc7-a191-1a903dc01b81', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.43', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:f5:55:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:57:53Z', 'updated_at': '2021-05-26T14:58:26Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:29.406686 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:58:29.417620 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:58:29.418309 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5a91700>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:58:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:29.485391 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-94aeca87-9d1d-43cd-9a69-69882ea0e10d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.486940 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-94aeca87-9d1d-43cd-9a69-69882ea0e10d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.1401856
May 26 14:58:29.562534 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70849019-c4c9-49e9-a13e-8e90a07aece1 req-ea847fba-95d1-412e-94ac-ce5cc6350592 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.564022 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-70849019-c4c9-49e9-a13e-8e90a07aece1 req-ea847fba-95d1-412e-94ac-ce5cc6350592 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1671288
May 26 14:58:29.621837 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:58:29.623731 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b22f5704-b507-4801-9a1a-b8ff83274138 req-1cd42601-2f66-413e-8abf-9074063df5ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.633462 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b22f5704-b507-4801-9a1a-b8ff83274138 req-1cd42601-2f66-413e-8abf-9074063df5ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1204410
May 26 14:58:29.637952 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-70849019-c4c9-49e9-a13e-8e90a07aece1 req-955b07fc-e42c-4786-a5c8-b478dbbdd56b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600216
May 26 14:58:29.648275 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-df11e697-14ea-49b5-a088-2f6600c484fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:29.649922 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-df11e697-14ea-49b5-a088-2f6600c484fd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1511228
May 26 14:58:29.686110 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b22f5704-b507-4801-9a1a-b8ff83274138 req-fbdb93f8-cda7-492f-8986-4586a9e1bb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513389
May 26 14:58:29.922201 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-9e2ceaa3-db53-4ad5-8ccf-c4b884dd4879 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2522633
May 26 14:58:30.074343 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-07b56bf5-7aa9-4266-a814-d268552492ee service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1455801
May 26 14:58:30.129447 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5a91700>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '3908a854-dbfa-4dc7-a191-1a903dc01b81', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.43', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:f5:55:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:57:53Z', 'updated_at': '2021-05-26T14:58:26Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:30.133524 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-69fa0a53-dac6-49d3-b67e-120f61dba143 None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '3908a854-dbfa-4dc7-a191-1a903dc01b81', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.43', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 124, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:f5:55:91', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:57:53Z', 'updated_at': '2021-05-26T14:58:26Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:58:30.350898 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55632) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:30.435369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d16ea9ea-3236-410a-96f4-b57e512283a3 None None] New status for floating IP 3908a854-dbfa-4dc7-a191-1a903dc01b81: ACTIVE {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 14:58:30.643634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:30.659245 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:30.663617 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Usage tracker for resource:security_group_rule and tenant:0dc05e48e6ad42c98f7153635d080a89 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:30.666142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:30.688773 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:30.877854 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:30.913592 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137b9269-fb6d-4800-b46b-416e24b1c22f req-b4570458-5f0f-4bff-90cd-6a79f4c6f0e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:30.915181 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-137b9269-fb6d-4800-b46b-416e24b1c22f req-b4570458-5f0f-4bff-90cd-6a79f4c6f0e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1017878
May 26 14:58:30.964987 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-137b9269-fb6d-4800-b46b-416e24b1c22f req-46b3c0aa-b691-4699-9245-9adbfb4dc778 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436676
May 26 14:58:31.013308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.025046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b88ce5df-2f88-4e0d-a49f-472d865a9e42 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:31.075236 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0dc05e48e6ad42c98f7153635d080a89&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7226548
May 26 14:58:31.079218 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55662) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:31.112160 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc7722a8-4f8d-4258-86fb-2971b35c46d6,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:31.128330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.128792 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.129127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.129474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.129841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.130180 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.130579 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.130855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.131193 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.131816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.131935 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.132195 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.136487 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7cdf4d26-2cb1-45f9-b722-1cf99765a6f3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:31.151303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.186977 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.187924 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3133cb-34d6-4044-bac7-50939636a64c req-f00dc72c-a58e-4327-93ef-f8ca2e43fcce tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:31.191334 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3b3133cb-34d6-4044-bac7-50939636a64c req-f00dc72c-a58e-4327-93ef-f8ca2e43fcce tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1232343
May 26 14:58:31.251123 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3b3133cb-34d6-4044-bac7-50939636a64c req-23dbcf70-3b83-4d2a-86c4-0869cd6f724c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0538402
May 26 14:58:31.346999 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.350865 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-703cbafc-1c7d-4056-933d-e9c775d459a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:31.361820 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc7722a8-4f8d-4258-86fb-2971b35c46d6,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.375638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.376361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.376361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.376518 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:31.379689 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:31.380709 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.385413 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fc7722a8-4f8d-4258-86fb-2971b35c46d6 HTTP/1.1" status: 204  len: 168 time: 0.3030922
May 26 14:58:31.468840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b8896f-3418-426c-ad26-ad388ff4f53b req-78e8e4b3-e5ec-434e-b6ce-374d47216949 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:31.470350 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c0b8896f-3418-426c-ad26-ad388ff4f53b req-78e8e4b3-e5ec-434e-b6ce-374d47216949 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.1172574
May 26 14:58:31.504392 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d11a8951-fd95-4a96-807b-b35ac2ef693f req-25b452b9-27b8-4552-9422-3e7ccfc66cb1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:31.505878 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d11a8951-fd95-4a96-807b-b35ac2ef693f req-25b452b9-27b8-4552-9422-3e7ccfc66cb1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0890901
May 26 14:58:31.514735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55678) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:31.520575 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'floatingip': {'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:31.526162 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c0b8896f-3418-426c-ad26-ad388ff4f53b req-581834cb-7b09-4a9d-9612-5738d533efa2 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0484324
May 26 14:58:31.612912 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.671094 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55686) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:31.835476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:31.850352 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:31.854549 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Usage tracker for resource:security_group_rule and tenant:7f76a138677c49d19ceeaf323f5a2edf is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:31.857313 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:31.867314 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:31.949898 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.088752 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.102210 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-721032e2-59c8-42bf-bc1c-5b8b3cad8cad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:32.147528 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=7f76a138677c49d19ceeaf323f5a2edf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4730368
May 26 14:58:32.147844 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55704) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:32.150610 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c928e21-1fc9-48a2-8657-13928661524c,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:32.162539 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:32.212123 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.239327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.272141 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5987eb58-812f-4150-8cf8-2d176790fc71 req-075e0d81-7a7b-4aaf-af1a-1a6e4393e31a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:32.273655 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5987eb58-812f-4150-8cf8-2d176790fc71 req-075e0d81-7a7b-4aaf-af1a-1a6e4393e31a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1985784
May 26 14:58:32.302841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55708) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:32.320868 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.337144 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5987eb58-812f-4150-8cf8-2d176790fc71 req-405a8523-6187-465f-8baa-b4ea59358e1f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0554302
May 26 14:58:32.338900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:32.342870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Usage tracker for resource:security_group_rule and tenant:f9bcdc3862a442649a56c469d403f748 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:32.346495 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:32.353234 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:32.477461 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.480525 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.489454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-570efd51-efab-4896-a6a2-2bac86fbac6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:32.503075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.508083 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c928e21-1fc9-48a2-8657-13928661524c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:32.512963 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:32.522995 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.526618 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0c928e21-1fc9-48a2-8657-13928661524c HTTP/1.1" status: 204  len: 168 time: 0.3755529
May 26 14:58:32.538231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.550241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55720) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:32.571373 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.618873 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:32.695298 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f9bcdc3862a442649a56c469d403f748&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3887362
May 26 14:58:32.696190 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55732) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:32.700054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e3dc05f-88f7-4b08-8a18-e7e6db0f9ebd,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:32.706550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:32.804385 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.835600 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.859325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:32.867054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:32.873504 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Floating IP f6d82bda-ca13-43e4-aa88-cfcb9153aeaa associated. External IP: 172.27.2.62, port: e948d481-711f-45b8-8deb-08b7658709e7.
May 26 14:58:32.873695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Usage tracker for resource:security_group_rule and tenant:8627ae6b237a4b39a6d6de7f1f48256b is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:32.884948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:32.900631 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:33.034878 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-916f7e70-041a-4b46-89c0-b177ba75b9f1 req-a2106729-229a-441c-8d07-8d83a74d88c7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:33.036413 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-916f7e70-041a-4b46-89c0-b177ba75b9f1 req-a2106729-229a-441c-8d07-8d83a74d88c7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.2936404
May 26 14:58:33.051022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.061864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:33.087812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e3dc05f-88f7-4b08-8a18-e7e6db0f9ebd,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:33.090446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.096745 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/6e3dc05f-88f7-4b08-8a18-e7e6db0f9ebd HTTP/1.1" status: 204  len: 168 time: 0.3987496
May 26 14:58:33.098000 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:33.218655 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-916f7e70-041a-4b46-89c0-b177ba75b9f1 req-86627feb-f7d2-4df1-a3c4-9b91fa219cc5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1739378
May 26 14:58:33.245681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.281072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-d73fe496-41a7-4e2e-9035-c3edd2ee9f38 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:33.283649 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-d73fe496-41a7-4e2e-9035-c3edd2ee9f38 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.32 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.1199362
May 26 14:58:33.343201 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 14:58:33.401717 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.419250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:33.471472 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=8627ae6b237a4b39a6d6de7f1f48256b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9076037
May 26 14:58:33.495388 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55746) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:33.508861 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f1b6e3f-ce67-4c4f-998b-cc4e3986878b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:33.532468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:33.685922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:58:33.686535 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.693910 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Deleting port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 14:58:33.694033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.694399 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.701682 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:58:33.715257 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:58:33.716340 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5a917f0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:58:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:33.727625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55754) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:33.765469 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1bb36816-0687-4721-b3d4-4e7b814bb455 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "PUT /v2.0/floatingips/f6d82bda-ca13-43e4-aa88-cfcb9153aeaa HTTP/1.1" status: 200  len: 991 time: 2.2494521
May 26 14:58:33.766222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:33.846403 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 req-d91d7b24-fea5-41aa-96d1-14230d848c63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:33.847936 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 req-d91d7b24-fea5-41aa-96d1-14230d848c63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.3196998
May 26 14:58:33.849864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.866770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:33.918428 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:58:33.937846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:33.979587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Usage tracker for resource:security_group_rule and tenant:c18541492d5d437fb8609c0e13a98299 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:33.983943 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'status': 'completed', 'code': 200}
May 26 14:58:33.990415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:34.009485 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 req-fb55cb4c-0b14-4e75-b0c1-75901d8d60e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1229315
May 26 14:58:34.020312 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:34.044469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] For port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,segment=NetworkSegment(fc5f4185-4145-44ee-8d30-2fdc2c29ad21),segment_id=fc5f4185-4145-44ee-8d30-2fdc2c29ad21)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:34.044469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.101881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-a089f0ec-b233-401e-bc09-b2b216f4701d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:34.103459 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-a089f0ec-b233-401e-bc09-b2b216f4701d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1099 time: 0.0889559
May 26 14:58:34.247542 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling delete_port for 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 14:58:34.282034 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-85d21875-01ed-4b08-9221-1dee48737f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:34.284182 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-85d21875-01ed-4b08-9221-1dee48737f89 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.1635590
May 26 14:58:34.367688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.376864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-05a58dd1-1f97-406e-a124-cfdff7bf5611 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:34.396127 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5a917f0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'f6d82bda-ca13-43e4-aa88-cfcb9153aeaa', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.62', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 146, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:58:04Z', 'updated_at': '2021-05-26T14:58:32Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:34.406955 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f1b6e3f-ce67-4c4f-998b-cc4e3986878b,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:34.410709 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:58:34.415010 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:34.428588 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:58:34.431854 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5a917f0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:58:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:34.493285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.494549 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7f1b6e3f-ce67-4c4f-998b-cc4e3986878b HTTP/1.1" status: 204  len: 168 time: 0.9913309
May 26 14:58:34.537412 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-8f904704-e9a9-437b-9beb-383fb34a86dc service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 999 time: 0.2438779
May 26 14:58:34.609203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.632024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.649438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:34.650471 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:58:34.662368 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 req-e1b687fa-b292-4df5-a4a3-5c8954149a8b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:34.662368 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 req-e1b687fa-b292-4df5-a4a3-5c8954149a8b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 945 time: 0.2220016
May 26 14:58:34.665075 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-02094e0c-4a69-4bf3-9181-eef02affb0c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:34.667063 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-02094e0c-4a69-4bf3-9181-eef02affb0c5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.1220987
May 26 14:58:34.732434 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Pushing event deleted for resources: {'Port': ['ID=24b593cd-0651-4f0f-aa78-c431b4dbb3f1,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:34.734408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.750066 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:34.761313 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0dd220d6-5e8b-4c2d-97bf-dd7628a951b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:34.802137 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 req-33b62983-458d-4010-995c-ef85063a9487 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/security-groups?id=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1340144
May 26 14:58:34.829848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] No DVR routers for this DVR port 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 14:58:34.843670 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:34.846513 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-eba91dc1-feec-44d2-a716-272ab5fe0765 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:34.849117 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-eba91dc1-feec-44d2-a716-272ab5fe0765 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1445360
May 26 14:58:34.850267 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'name': 'network-vif-deleted', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:34.875421 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c18541492d5d437fb8609c0e13a98299&name=default HTTP/1.1" status: 200  len: 2979 time: 1.1452506
May 26 14:58:34.887925 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55794) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:34.918571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b04122e1-08e6-46f1-a297-e77be6b4bc09,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:34.945871 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.185s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:34.967108 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2b37b708-5d64-4e1f-9e17-32f528641ca5', 'name': 'network-vif-deleted', 'tag': '24b593cd-0651-4f0f-aa78-c431b4dbb3f1', 'status': 'completed', 'code': 200}
May 26 14:58:34.972034 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55800) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:34.982543 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c4183450-3f28-4a21-95e0-1e552d083f4a req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.32 "DELETE /v2.0/ports/24b593cd-0651-4f0f-aa78-c431b4dbb3f1 HTTP/1.1" status: 204  len: 173 time: 1.6934941
May 26 14:58:35.037661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.110307 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-99473734-5c69-47e2-8a73-02ffbd1810ff service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2390316
May 26 14:58:35.118284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.242606 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1185632472-network', 'tenant_id': 'be67b3bbd52c4c3f8e955c9ce1c5855e'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:35.247785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:35.252992 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Usage tracker for resource:network and tenant:be67b3bbd52c4c3f8e955c9ce1c5855e is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:35.256331 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:35.274330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:35.293300 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-50d773a3-c8f1-4d85-a3ed-afdf32304ec5 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1739609
May 26 14:58:35.307654 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5a917f0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'f6d82bda-ca13-43e4-aa88-cfcb9153aeaa', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.62', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 146, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:58:04Z', 'updated_at': '2021-05-26T14:58:32Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:35.312690 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b84697e7-eec0-45cf-83c6-4ea670d14962 None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'f6d82bda-ca13-43e4-aa88-cfcb9153aeaa', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.62', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 146, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T14:58:04Z', 'updated_at': '2021-05-26T14:58:32Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:58:35.368499 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73c7d60e-db8a-477e-8dba-18469fdc5809 req-b7227714-02e9-4dc3-9ac0-e2d879890cac tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:35.369996 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73c7d60e-db8a-477e-8dba-18469fdc5809 req-b7227714-02e9-4dc3-9ac0-e2d879890cac tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1070046
May 26 14:58:35.410661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.414063 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Made reservation on behalf of be67b3bbd52c4c3f8e955c9ce1c5855e for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:35.416311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.435184 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-5ff5c61a-ef46-41e2-8e16-6ca7f5874440 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:35.443901 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55810) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:35.449029 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73c7d60e-db8a-477e-8dba-18469fdc5809 req-27afb8cc-905b-4dd8-b8e2-47ffc89d9669 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0733657
May 26 14:58:35.451382 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.462919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b04122e1-08e6-46f1-a297-e77be6b4bc09,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:35.484399 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:35.484494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.484576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:35.484576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Usage tracker for resource:security_group_rule and tenant:be67b3bbd52c4c3f8e955c9ce1c5855e is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:35.484576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:35.488204 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:35.489602 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.490649 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b04122e1-08e6-46f1-a297-e77be6b4bc09 HTTP/1.1" status: 204  len: 168 time: 0.6016879
May 26 14:58:35.491706 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:35.492301 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Usage tracker for resource:security_group_rule and tenant:608d682e04db4473b191d2a3867c8197 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:35.508270 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:35.515280 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:35.568474 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60c9dc34-63bb-40db-b496-6cdef7b39fd2 None None] New status for floating IP f6d82bda-ca13-43e4-aa88-cfcb9153aeaa: ACTIVE {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 14:58:35.622658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.647792 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.728912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.729204 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.744531 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c0e43678-0922-4f3f-ada4-43a846585abd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:35.748740 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1238}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:58:35.766634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.769475 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Added segment 2bd9fcdf-68e4-455c-82b4-2c96cd936467 of type vlan for network a9824a3c-ffc1-4714-9231-01e04e6011f0
May 26 14:58:35.789724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=608d682e04db4473b191d2a3867c8197&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3446872
May 26 14:58:35.793244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55816) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:35.801016 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86a534e5-9c31-4efd-a1d8-be618b7ba222,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:35.815954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:35.834808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.891687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.905645 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-18cb01a2-d52f-470b-b4bd-2299d224585a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:35.933497 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:35.942561 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b6f41d2-da34-4d2c-b4e2-12c554b2dade,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:35.947111 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:36.027461 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.030088 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:36.030088 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.062336 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed50d87a-344a-4277-b2c1-5dd55d6e110d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:36.105202 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.110851 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1f3b2dfc-be09-4dcc-ae7a-c63f6198d612 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:36.124845 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86a534e5-9c31-4efd-a1d8-be618b7ba222,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:36.128027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:36.130125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.133652 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/86a534e5-9c31-4efd-a1d8-be618b7ba222 HTTP/1.1" status: 204  len: 168 time: 0.3370769
May 26 14:58:36.166397 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 14:58:36.219669 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 14:58:36.220027 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24b593cd-0651-4f0f-aa78-c431b4dbb3f1 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 14:58:36.257407 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ee502f1d-6c12-48dd-8d74-0386ab680f66 req-490f6d77-3f1a-4173-a8ee-ec302e5407aa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Synchronizing usage tracker for tenant:e0f665681e524725b9abb121531f47a5 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:36.268939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Pushing event updated for resources: {'Network': ['ID=a9824a3c-ffc1-4714-9231-01e04e6011f0,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:36.272808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:36.280022 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network a9824a3c-ffc1-4714-9231-01e04e6011f0 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:58:36.287318 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:58:36.318353 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 1.3450301
May 26 14:58:36.321249 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55840) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:36.327047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Request body: {'subnet': {'network_id': 'a9824a3c-ffc1-4714-9231-01e04e6011f0', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1185632472-subnet', 'tenant_id': 'be67b3bbd52c4c3f8e955c9ce1c5855e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:36.332953 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:36.337830 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Usage tracker for resource:subnet and tenant:be67b3bbd52c4c3f8e955c9ce1c5855e is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:36.341083 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:36.347432 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:36.350387 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ee502f1d-6c12-48dd-8d74-0386ab680f66 req-490f6d77-3f1a-4173-a8ee-ec302e5407aa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Unset dirty status for tenant:e0f665681e524725b9abb121531f47a5 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:36.351632 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ee502f1d-6c12-48dd-8d74-0386ab680f66 req-490f6d77-3f1a-4173-a8ee-ec302e5407aa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /v2.0/ports?device_id=2b37b708-5d64-4e1f-9e17-32f528641ca5 HTTP/1.1" status: 200  len: 210 time: 0.2615185
May 26 14:58:36.449157 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Made reservation on behalf of be67b3bbd52c4c3f8e955c9ce1c5855e for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:36.457622 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.704407 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd5289f-5b12-40ff-a563-8759d00fcf0d req-ed490837-03d2-4b7f-a205-e8262609bc28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:36.712587 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bd5289f-5b12-40ff-a563-8759d00fcf0d req-ed490837-03d2-4b7f-a205-e8262609bc28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1296079
May 26 14:58:36.757840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55852) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:36.759644 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bd5289f-5b12-40ff-a563-8759d00fcf0d req-4a33d012-d459-45f8-b40d-996fc2f26bea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461524
May 26 14:58:36.971412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:36.976136 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-607871e6-b23c-488e-aa22-da59e4e84a76 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:37.011407 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55860) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:37.032249 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.047632 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:37.052021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Usage tracker for resource:security_group_rule and tenant:586d28115edd442bb1c89e5670e5a7b0 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:37.054867 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:37.056707 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.060801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:37.081278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Pushing event updated for resources: {'Subnet': ['ID=2efb9823-ab44-4481-9508-a3571a81505e,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:37.085770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:37.086821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:37.093381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Usage tracker for resource:security_group_rule and tenant:22968d4f272d4ca9a4edf6c004e018ff is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:37.098607 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:37.101646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Checking segment: {'id': '2bd9fcdf-68e4-455c-82b4-2c96cd936467', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1238, 'network_id': 'a9824a3c-ffc1-4714-9231-01e04e6011f0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:37.101646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Network hostable DHCP agents. Network: a9824a3c-ffc1-4714-9231-01e04e6011f0, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:58:37.108251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:37.154402 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.202152 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.222404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Network a9824a3c-ffc1-4714-9231-01e04e6011f0 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:58:37.264907 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.272987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-957ce2ee-cfd7-4025-9dfc-c433d073039e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:37.293920 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, a9824a3c-ffc1-4714-9231-01e04e6011f0) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:37.295624 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.303880 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f108ad5-7e89-4fbc-a494-675da6b3240c None None] Network a9824a3c-ffc1-4714-9231-01e04e6011f0 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:37.307853 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c2ad768e-535a-4b67-a87e-3014c317f992 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:37.320361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=52ff3ebb-1da3-4264-aeb8-bffbf49ad62c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:37.327508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:37.336190 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=586d28115edd442bb1c89e5670e5a7b0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3233602
May 26 14:58:37.339058 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55874) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:37.352713 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:37.353528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.421144 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a3a3225-4c13-4ba4-a2e2-b5eae8d43e4e,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:37.440265 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=22968d4f272d4ca9a4edf6c004e018ff&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6804931
May 26 14:58:37.441577 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:37.444675 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55882) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:37.480370 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.510245 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.525120 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.2025788
May 26 14:58:37.564511 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.595621 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6ecb2b72-878e-449b-a599-fd96189023e4 None None] Network a9824a3c-ffc1-4714-9231-01e04e6011f0 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:37.622789 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.664970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.670334 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5de5d9b2-71b5-48eb-87a9-3f9bac09ba79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:37.693966 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=52ff3ebb-1da3-4264-aeb8-bffbf49ad62c,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:37.697285 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:37.709707 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.712945 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/52ff3ebb-1da3-4264-aeb8-bffbf49ad62c HTTP/1.1" status: 204  len: 168 time: 0.3729753
May 26 14:58:37.757339 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.762343 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:37.931594 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a3a3225-4c13-4ba4-a2e2-b5eae8d43e4e,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:37.943314 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:37.945994 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:37.947393 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/1a3a3225-4c13-4ba4-a2e2-b5eae8d43e4e HTTP/1.1" status: 204  len: 168 time: 0.5018759
May 26 14:58:38.054654 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 req-2701a655-d933-48f2-945e-adfaf9ef9d76 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:38.056107 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 req-2701a655-d933-48f2-945e-adfaf9ef9d76 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0945995
May 26 14:58:38.113827 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 req-98641b8e-f574-4416-9d2d-3587e5944bdf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519774
May 26 14:58:38.974160 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 55976) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:38.992925 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.008750 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:39.012673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Usage tracker for resource:security_group_rule and tenant:63f025f851154a8d9ac1a787bef9ee14 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:39.023769 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:39.023769 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:39.077337 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55982) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:39.083034 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1627975140-network', 'tenant_id': 'bfd47b2be803402bbd63197e7de29d49'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:39.090247 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:39.095123 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Usage tracker for resource:network and tenant:bfd47b2be803402bbd63197e7de29d49 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:39.098488 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:39.104508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:39.112943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.174454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.181835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:39.225165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1666436a-f632-4213-9ca6-4539551c056f,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:39.228623 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:39.231102 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=63f025f851154a8d9ac1a787bef9ee14&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2559018
May 26 14:58:39.238204 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 55990) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:39.285314 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Made reservation on behalf of bfd47b2be803402bbd63197e7de29d49 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:39.287943 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.303502 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.324330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 req-8524984f-f980-4470-b53c-5ac1828d8709 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:39.326443 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 req-8524984f-f980-4470-b53c-5ac1828d8709 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0935264
May 26 14:58:39.332413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:39.340011 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Usage tracker for resource:security_group_rule and tenant:bfd47b2be803402bbd63197e7de29d49 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:39.342726 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.344549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:39.357431 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:39.374933 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 req-498c20f5-493c-4980-a038-ebc91f939607 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427527
May 26 14:58:39.385021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.510282 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.529483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.538969 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:39.565432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1666436a-f632-4213-9ca6-4539551c056f,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:39.568347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:39.576408 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.577630 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/1666436a-f632-4213-9ca6-4539551c056f HTTP/1.1" status: 204  len: 168 time: 0.3382206
May 26 14:58:39.586345 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.589397 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:39.630170 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1204}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:58:39.645368 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf7ec22d-2f1e-4b6b-8c35-5466cb4f3397,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:39.648909 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:39.654059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.654771 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Added segment 01f9b25f-0bf6-4e00-b951-96b5f3242baa of type vlan for network 98b875f8-86e8-4b25-ba8a-587bb370c050
May 26 14:58:39.688575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56024) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:39.697666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.767756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Deleting subnet fff245df-826f-4da5-acad-7148fe1aea38 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 14:58:39.771266 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.801981 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.803861 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:39.805367 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.816136 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:39.836876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.908470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:39.932550 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Pushing event updated for resources: {'Network': ['ID=98b875f8-86e8-4b25-ba8a-587bb370c050,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:39.935315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:39.943712 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 98b875f8-86e8-4b25-ba8a-587bb370c050 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:58:40.008607 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.9299786
May 26 14:58:40.011651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56038) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:40.018350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Request body: {'subnet': {'network_id': '98b875f8-86e8-4b25-ba8a-587bb370c050', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1627975140-subnet', 'tenant_id': 'bfd47b2be803402bbd63197e7de29d49', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:40.039924 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:40.054746 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Usage tracker for resource:subnet and tenant:bfd47b2be803402bbd63197e7de29d49 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:40.066867 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:40.081437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:40.185958 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Made reservation on behalf of bfd47b2be803402bbd63197e7de29d49 for: {'subnet': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:40.188941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2161934'] for subnet, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.312291 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.317455 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:40.352210 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fff245df-826f-4da5-acad-7148fe1aea38,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:40.355475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:40.356640 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.366577 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-48f3cbac-1757-4e8c-a576-d01bb81c7cc6 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/fff245df-826f-4da5-acad-7148fe1aea38 HTTP/1.1" status: 204  len: 168 time: 0.6766117
May 26 14:58:40.369211 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56046) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:40.402608 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56050) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:40.430322 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.445841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:40.449834 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Usage tracker for resource:security_group_rule and tenant:25325d0b96f1465fb2fc2e867175e4b4 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:40.452836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:40.463886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:40.511876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.588191 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.631765 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.643900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ab9eb938-c35d-4190-8515-7b764e844e5a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:40.667490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56060) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:40.701891 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a869513-5b92-4966-8e4d-54478b39348f,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:40.706091 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:40.708483 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=25325d0b96f1465fb2fc2e867175e4b4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3048768
May 26 14:58:40.711125 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56066) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:40.781494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.781955 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.807535 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4bdfb80>,) {'filters': {'network_id': ['fc8154d0-713e-4031-a1fb-bb0dd6440711']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:40.819901 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.824924 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4bdfb80>, 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:40.825218 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4bdfb80>, 'fc5f4185-4145-44ee-8d30-2fdc2c29ad21') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:58:40.843257 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.849716 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.861845 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e408b90-b8f6-4eaf-a266-0820147dc62c req-aae768e6-7a0b-48da-8e44-387cac53cb64 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:40.864809 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8e408b90-b8f6-4eaf-a266-0820147dc62c req-aae768e6-7a0b-48da-8e44-387cac53cb64 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.3434722
May 26 14:58:40.876405 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:40.878354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.888517 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Usage tracker for resource:security_group_rule and tenant:39ffc5d64c524dd3af1c0997eb41ea41 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:40.894661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:40.902648 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Releasing vlan 1228 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 14:58:40.902965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:40.903071 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 14:58:40.920894 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 14:58:40.991445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.030973 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8e408b90-b8f6-4eaf-a266-0820147dc62c req-f56f8286-18b4-4df5-86ed-01a7300174db tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1562924
May 26 14:58:41.053285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.058476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-05393923-e113-4432-a076-3ccb25abf008 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:41.074003 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a869513-5b92-4966-8e4d-54478b39348f,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:41.077942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:41.083659 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.090604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4ca22ccd-a152-4e58-a327-7cf80386d612 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:41.101586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.102892 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/8a869513-5b92-4966-8e4d-54478b39348f HTTP/1.1" status: 204  len: 168 time: 0.3904438
May 26 14:58:41.111677 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2226144', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2161944'] for subnet, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.116600 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:41.136634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=000ced91-b99a-4e75-b33f-5ecbdd1b844b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:41.143926 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=39ffc5d64c524dd3af1c0997eb41ea41&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4718056
May 26 14:58:41.143926 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:41.144211 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56074) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:41.166127 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.186380 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.193793 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=948466e0-84bf-4a37-a671-3629d6052665,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:41.203177 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:41.209347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7389f67a-1229-45bd-84be-01fe2a083c9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.031s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:41.228439 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] 10.222.0.81 "DELETE /v2.0/networks/fc8154d0-713e-4031-a1fb-bb0dd6440711 HTTP/1.1" status: 204  len: 168 time: 0.8581517
May 26 14:58:41.233606 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Pushing event deleted for resources: {'Network': ['ID=fc8154d0-713e-4031-a1fb-bb0dd6440711,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:41.237053 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:41.240411 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.243965 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Checking segment: {'id': '01f9b25f-0bf6-4e00-b951-96b5f3242baa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1204, 'network_id': '98b875f8-86e8-4b25-ba8a-587bb370c050'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:41.244318 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Network hostable DHCP agents. Network: 98b875f8-86e8-4b25-ba8a-587bb370c050, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103981) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:58:41.282781 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.300026 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Network 98b875f8-86e8-4b25-ba8a-587bb370c050 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103981) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:58:41.352507 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 98b875f8-86e8-4b25-ba8a-587bb370c050) {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:41.362531 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c5ee205a-4033-4660-96ad-5642eb553c75 None None] Network 98b875f8-86e8-4b25-ba8a-587bb370c050 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:41.365664 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:41.366450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.397646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.408942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bceb0bf3-314b-44d6-b2af-d0e691b3390a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:41.420063 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=000ced91-b99a-4e75-b33f-5ecbdd1b844b,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:41.425878 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:41.428469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.429809 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/000ced91-b99a-4e75-b33f-5ecbdd1b844b HTTP/1.1" status: 204  len: 168 time: 0.2846782
May 26 14:58:41.467270 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e540ddc5-d097-41a7-9e9c-f4ec1e3146e7 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.4544914
May 26 14:58:41.616637 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-66b1cd2b-ce7b-4f8c-ad14-7cf03e4ca32b None None] Network 98b875f8-86e8-4b25-ba8a-587bb370c050 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:41.673847 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56092) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:41.740546 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-69594748-5e55-478e-99df-7b00867305b2 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e0f665681e524725b9abb121531f47a5&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0652187
May 26 14:58:41.742964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56098) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:41.837771 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:41.868821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:42.060825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:42.066868 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c6ad2c13-7582-4938-9a18-5d298f70138a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:42.090114 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:42.104881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:42.211253 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:42.212865 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/1ec5fa67-9888-4c29-8d2e-9e4c62e03b8c HTTP/1.1" status: 204  len: 168 time: 0.4687846
May 26 14:58:42.256607 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 req-f957dd42-324b-4c19-bb4e-25980eeeba89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:42.258118 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 req-f957dd42-324b-4c19-bb4e-25980eeeba89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1007304
May 26 14:58:42.340166 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 req-2b62f237-7e93-47dd-bc62-1fbc34253b7f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0762386
May 26 14:58:43.552166 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8fa867b-9100-4804-a852-745ffe1c3d1b req-6998f232-3ea7-4698-8f90-cdd21fcb3cd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:43.553674 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c8fa867b-9100-4804-a852-745ffe1c3d1b req-6998f232-3ea7-4698-8f90-cdd21fcb3cd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0957408
May 26 14:58:43.608934 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c8fa867b-9100-4804-a852-745ffe1c3d1b req-708b0ec6-367c-4d19-a1cc-49dac987300f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0495067
May 26 14:58:43.846611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56190) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:44.164949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.180659 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:44.185123 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Usage tracker for resource:security_group_rule and tenant:dd6bce5b15074362a13083827d95bcfe is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:44.188603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:44.209245 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:44.209377 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56212) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:44.316120 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.401842 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.414116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1535301060-network', 'tenant_id': '1515325707f64d58a28f26451b2c74de'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:44.414267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-40d254b4-8e79-4490-875c-43da0577a186 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:44.419162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:44.424558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Usage tracker for resource:network and tenant:1515325707f64d58a28f26451b2c74de is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:44.428782 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:44.441649 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:44.458876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21e06cbe-f004-4cc5-9998-39bca69f2d91,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:44.462841 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:44.468487 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=dd6bce5b15074362a13083827d95bcfe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6222377
May 26 14:58:44.469073 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56222) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:44.516612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:44.520124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.542052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.563015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:44.568175 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Usage tracker for resource:security_group_rule and tenant:1515325707f64d58a28f26451b2c74de is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:44.571617 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:44.578642 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:44.620406 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.659545 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.698806 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.757353 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.761707 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1f876306-2f75-44ad-af43-f5aa68b6f5b7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:44.791758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.798032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c526876-cea7-4668-add2-ed80890372e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:44.822329 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21e06cbe-f004-4cc5-9998-39bca69f2d91,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:44.822512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1233}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:58:44.848370 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:44.853305 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e5a87ad-2426-461e-a6cd-24bd29f13f42,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:44.853464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.856577 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.856917 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Added segment b964941b-0faf-494a-9f72-f6f580306e25 of type vlan for network 5bdb145e-267b-43cd-9426-f92f373c5ed5
May 26 14:58:44.870379 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/21e06cbe-f004-4cc5-9998-39bca69f2d91 HTTP/1.1" status: 204  len: 168 time: 0.3999858
May 26 14:58:44.885457 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:44.917317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:44.939629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd2920c-2428-450e-aed7-a96925330183 req-53ca8f6e-fdb1-4f75-88dd-273e68c892b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:44.941103 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8bd2920c-2428-450e-aed7-a96925330183 req-53ca8f6e-fdb1-4f75-88dd-273e68c892b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1709290
May 26 14:58:44.997977 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8bd2920c-2428-450e-aed7-a96925330183 req-387963f1-7d71-4b81-974c-39630d33ee48 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0471704
May 26 14:58:45.031888 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:45.033870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:45.034445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:45.039447 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:45.140475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Pushing event updated for resources: {'Network': ['ID=5bdb145e-267b-43cd-9426-f92f373c5ed5,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:45.144306 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:45.154047 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:58:45.248269 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 1.0376635
May 26 14:58:45.251195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56252) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:45.259733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Request body: {'subnet': {'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1535301060-subnet', 'tenant_id': '1515325707f64d58a28f26451b2c74de', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:45.270170 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:45.277721 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Usage tracker for resource:subnet and tenant:1515325707f64d58a28f26451b2c74de is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:45.280579 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:45.287846 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:45.362594 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'subnet': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:45.370261 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2161934'] for subnet, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:45.851354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2226144', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2161944'] for subnet, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:45.856350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:45.932599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Pushing event updated for resources: {'Subnet': ['ID=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:45.936489 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:45.937186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Checking segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:45.937556 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Network hostable DHCP agents. Network: 5bdb145e-267b-43cd-9426-f92f373c5ed5, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103981) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:58:46.043220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103981) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:58:46.159035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 5bdb145e-267b-43cd-9426-f92f373c5ed5) {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:46.169944 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bed01464-7fdb-486c-9687-f520704f4e88 None None] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:46.183486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:46.184075 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:46.228118 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5787beda-f2cf-42d9-851a-22c9794f9a9e req-de151560-f59d-45ee-9f99-07ed2151e17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:46.229704 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5787beda-f2cf-42d9-851a-22c9794f9a9e req-de151560-f59d-45ee-9f99-07ed2151e17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1153181
May 26 14:58:46.271701 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 1.0178177
May 26 14:58:46.320899 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5787beda-f2cf-42d9-851a-22c9794f9a9e req-6e1cc892-5e2c-492f-b821-996ef778b32d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0853708
May 26 14:58:46.423731 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f732ca16-67aa-48fe-907f-874d02d418a3 None None] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:58:46.988153 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-929ee5ba-835b-4e72-aa7a-c88671b00274 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:46.988929 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-929ee5ba-835b-4e72-aa7a-c88671b00274 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:network {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:47.097283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-929ee5ba-835b-4e72-aa7a-c88671b00274 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:network {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:47.098517 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-929ee5ba-835b-4e72-aa7a-c88671b00274 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.3163087
May 26 14:58:47.114079 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-8d4e2564-9190-487e-95c9-ad69a273fb79 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/quotas/1515325707f64d58a28f26451b2c74de HTTP/1.1" status: 200  len: 375 time: 0.0098901
May 26 14:58:47.162572 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-6e1b3d7e-6bd2-41c4-a0de-f657b89e5604 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0428789
May 26 14:58:47.327075 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-3d1ce746-c19d-41a0-b416-159b725df281 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1560035
May 26 14:58:47.542735 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-7075c5b1-1484-4151-8dc0-12de47b31796 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2112761
May 26 14:58:47.584853 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46a3bb4c-3665-429c-b4fe-ef018eee33ae req-faf946e0-5b0b-4eb5-b1fb-d131cbe2fbd6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:47.586496 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-46a3bb4c-3665-429c-b4fe-ef018eee33ae req-faf946e0-5b0b-4eb5-b1fb-d131cbe2fbd6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0953510
May 26 14:58:47.633487 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-46a3bb4c-3665-429c-b4fe-ef018eee33ae req-ab467212-f717-49fa-973e-8ca7cfe4213e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410559
May 26 14:58:47.874221 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2fcc02d5-d677-455d-bef2-0323dafc699a req-426ebe5d-f2a8-499f-b755-89d1a3a374ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0561152
May 26 14:58:48.875319 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb41c3ee-883c-4c34-8467-60e5baa7e531 req-2f4b01e6-8db7-4e98-ba82-91f324c5be02 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:48.877776 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fb41c3ee-883c-4c34-8467-60e5baa7e531 req-2f4b01e6-8db7-4e98-ba82-91f324c5be02 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1241667
May 26 14:58:48.934705 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fb41c3ee-883c-4c34-8467-60e5baa7e531 req-cc7f6d62-1af5-4f72-8c52-9968fbeb7bc8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494945
May 26 14:58:49.075881 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9d437bc6-01c7-4534-80c7-37bff38d55a6 req-2ebb2bb2-96bb-4191-b1cd-fd4d6b543350 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0463476
May 26 14:58:49.630044 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56392) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:49.749824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:49.765053 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:49.770158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Usage tracker for resource:security_group_rule and tenant:2013f1dc14d849d8b7428a6401895a9e is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:49.772970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:49.778856 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:49.860028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:49.921922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:49.931125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:49.977748 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2013f1dc14d849d8b7428a6401895a9e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3465316
May 26 14:58:49.978425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56402) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:49.990608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc2c3ed7-58fe-4b55-95c2-42857faa5ed3,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:49.994121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:50.056984 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.140483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.213343 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9e41215-3651-4d59-a49f-75e0ec489990 req-b317cd66-fb79-4908-8248-0e8c098d5b04 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:50.213343 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9e41215-3651-4d59-a49f-75e0ec489990 req-b317cd66-fb79-4908-8248-0e8c098d5b04 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1416731
May 26 14:58:50.296381 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9e41215-3651-4d59-a49f-75e0ec489990 req-46d98317-53a6-4619-96ce-2f4f17ac66b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0668576
May 26 14:58:50.317082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.322378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-330d18d7-95d9-45e7-aa9f-193cdb83188f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:50.342894 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc2c3ed7-58fe-4b55-95c2-42857faa5ed3,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:50.347930 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:50.352027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.353365 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fc2c3ed7-58fe-4b55-95c2-42857faa5ed3 HTTP/1.1" status: 204  len: 168 time: 0.3736558
May 26 14:58:50.386124 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6a686340-0f19-4c61-b30e-877e96567b3d req-70e572ed-3395-4feb-8be9-900b26dc27c6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0742269
May 26 14:58:50.438547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-6936ced5-4d66-4858-8a4b-3c8244a57db8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:50.440174 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-6936ced5-4d66-4858-8a4b-3c8244a57db8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.2985425
May 26 14:58:50.456861 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Request body: {'port': {'device_id': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'admin_state_up': True, 'tenant_id': '1515325707f64d58a28f26451b2c74de'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:50.529007 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-3c89c553-d216-4c86-8327-5a89383fb973 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.615612 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:50.620052 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Usage tracker for resource:port and tenant:1515325707f64d58a28f26451b2c74de is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:50.623868 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Quota usage for port was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:50.630534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:50.717414 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:58:50.722231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:50.930900 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Allocated IP 172.20.0.7 (5bdb145e-267b-43cd-9426-f92f373c5ed5/a5c1fbe6-787f-4fc0-9f39-1179f60b94a5/5969b659-5456-4b6d-84cd-6a9fdbac70df) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:58:51.148557 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.190486 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56434) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:51.223221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.243979 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:58:51.248909 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Usage tracker for resource:security_group_rule and tenant:5029e4708a744fed94297bb540b2578e is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:58:51.253888 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:58:51.260781 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:58:51.289168 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.307311 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-15cd9fac-1d17-4851-9916-913de163e18e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:51.368374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.415188 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.419804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:58:51.424605 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:58:51.434703 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:58:51.451327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:51.497618 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5029e4708a744fed94297bb540b2578e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3057234
May 26 14:58:51.498760 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56448) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:58:51.499695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2cf54517-db33-485f-8d56-6abe221a8d8e,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:51.537235 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:51.605849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.648489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.721595 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event updated for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:51.733504 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.426s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:51.761805 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:51.762706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.834679 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a req-58ba1b92-3505-4879-a95a-baa98df434c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:51.836177 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a req-58ba1b92-3505-4879-a95a-baa98df434c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1086915
May 26 14:58:51.857615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.865235 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:51.880208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2cf54517-db33-485f-8d56-6abe221a8d8e,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:51.883042 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:51.901097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:51.902558 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/2cf54517-db33-485f-8d56-6abe221a8d8e HTTP/1.1" status: 204  len: 168 time: 0.3874300
May 26 14:58:51.914093 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a req-e9d26f72-22c6-45e6-a36a-d7a7b49b6637 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0723505
May 26 14:58:51.923065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 req-86af4ac4-d4bc-4836-874b-972300e6f354 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:51.923065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 req-86af4ac4-d4bc-4836-874b-972300e6f354 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:51.930481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4800594
May 26 14:58:51.949772 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Request body: {'port': {'device_id': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:58:52.077033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:52.125116 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 req-86af4ac4-d4bc-4836-874b-972300e6f354 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:52.126638 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 req-86af4ac4-d4bc-4836-874b-972300e6f354 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 931 time: 0.2939162
May 26 14:58:52.229153 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 req-e5db3695-3509-4280-b0cc-40a7ec344e08 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0954218
May 26 14:58:52.498289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5969b659-5456-4b6d-84cd-6a9fdbac70df {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:52.507474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:52.522564 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Transition to ACTIVE for port object 5969b659-5456-4b6d-84cd-6a9fdbac70df will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:58:52.602091 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:52.606309 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:52.769994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Pushing event updated for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:52.777630 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:52.873706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Attempting to bind port 5969b659-5456-4b6d-84cd-6a9fdbac70df on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:58:52.874064 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Attempting to bind port 5969b659-5456-4b6d-84cd-6a9fdbac70df by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:58:52.874348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Attempting to bind port 5969b659-5456-4b6d-84cd-6a9fdbac70df on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:52.879812 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Port 5969b659-5456-4b6d-84cd-6a9fdbac70df on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:58:52.880273 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Attempting to bind port 5969b659-5456-4b6d-84cd-6a9fdbac70df on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:58:52.886963 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 58, 27), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:58:52.887077 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Checking segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:58:52.887765 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Bound using segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:58:52.888082 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Bound port: 5969b659-5456-4b6d-84cd-6a9fdbac70df, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:58:52.888484 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:52.995250 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:58:52.999402 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:58:53.083652 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:53.093428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-37c1b7b4-8b84-4a7e-91de-8473acdbe365 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:53.117375 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:53.174816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7519c39-7a6e-450d-9475-abfd18e85054 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:53.177102 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471bd7e6-53ab-47d3-8395-adda563bfbb8 req-fcb49298-5dec-4858-b3c3-46cb7510f308 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.178840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.179591 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-471bd7e6-53ab-47d3-8395-adda563bfbb8 req-fcb49298-5dec-4858-b3c3-46cb7510f308 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1295605
May 26 14:58:53.179703 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:53.183721 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] 10.222.0.32 "PUT /v2.0/ports/5969b659-5456-4b6d-84cd-6a9fdbac70df HTTP/1.1" status: 200  len: 1093 time: 1.2356610
May 26 14:58:53.194120 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:58:53.239155 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Pushing event updated for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:53.245665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:53.247410 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-471bd7e6-53ab-47d3-8395-adda563bfbb8 req-55c4a7cf-ec7b-414d-9b67-cb51672feaaa tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0577104
May 26 14:58:53.269929 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df', 'status': 'completed', 'code': 200}
May 26 14:58:53.431427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-dc0b2cb1-5b55-45ea-9382-e6b7894d02e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.432928 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-dc0b2cb1-5b55-45ea-9382-e6b7894d02e6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 1096 time: 0.1392794
May 26 14:58:53.512332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17c8a363-12cb-421d-81f1-5bf894ab902c req-707d056c-781c-4a7d-b1d0-7c4e89ccdc25 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.514529 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-17c8a363-12cb-421d-81f1-5bf894ab902c req-707d056c-781c-4a7d-b1d0-7c4e89ccdc25 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 943 time: 0.1260092
May 26 14:58:53.565318 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-17c8a363-12cb-421d-81f1-5bf894ab902c req-612ce285-c1e4-4241-b161-77da7de3b3b4 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:58:53.605682 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-e3c2359e-6dd4-43ac-bf8f-6d44de4816e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.607407 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-e3c2359e-6dd4-43ac-bf8f-6d44de4816e5 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=1515325707f64d58a28f26451b2c74de&shared=False HTTP/1.1" status: 200  len: 917 time: 0.1625738
May 26 14:58:53.625658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-17c8a363-12cb-421d-81f1-5bf894ab902c req-612ce285-c1e4-4241-b161-77da7de3b3b4 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:58:53.627486 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-17c8a363-12cb-421d-81f1-5bf894ab902c req-612ce285-c1e4-4241-b161-77da7de3b3b4 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1065197
May 26 14:58:53.785163 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-f59e2181-0f9c-442d-a4c0-6deeae08e930 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.787576 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-f59e2181-0f9c-442d-a4c0-6deeae08e930 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1731956
May 26 14:58:53.920183 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-7d29a366-f5a7-48b1-9b9e-24aeb1cc1fbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:53.924031 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-7d29a366-f5a7-48b1-9b9e-24aeb1cc1fbd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 1096 time: 0.0854506
May 26 14:58:54.006724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-effd4af6-1c66-4c2d-8a7a-2bd60c936fd1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df HTTP/1.1" status: 200  len: 217 time: 0.0773385
May 26 14:58:54.049077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:54.080458 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-c4939e2e-5e40-4210-83ce-01a6c372a9ba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:54.081962 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-c4939e2e-5e40-4210-83ce-01a6c372a9ba service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 200  len: 855 time: 0.0675232
May 26 14:58:54.224155 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-5e55cfc6-dc3b-47da-bc15-eaf867f16171 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=5bdb145e-267b-43cd-9426-f92f373c5ed5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1346180
May 26 14:58:54.401575 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-a12381f9-b633-4db2-ab4b-6daa440223fd service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1664667
May 26 14:58:54.443802 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1648b945-5237-4443-8821-8903984b32e9 req-ab7cf4b3-8f9b-4b51-ac0f-07890e27fabf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:54.445516 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1648b945-5237-4443-8821-8903984b32e9 req-ab7cf4b3-8f9b-4b51-ac0f-07890e27fabf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0945284
May 26 14:58:54.508514 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1648b945-5237-4443-8821-8903984b32e9 req-9b8943e3-8b94-422f-b653-5c78d91ecf53 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0571451
May 26 14:58:54.570481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 req-266023c8-dd0e-47fe-b17a-3538d6756d70 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1614106
May 26 14:58:54.843423 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb req-38b28157-53df-48da-af0f-a1419b8b9ef0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:54.845281 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb req-38b28157-53df-48da-af0f-a1419b8b9ef0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 943 time: 0.0995991
May 26 14:58:54.905049 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb req-58406c44-b186-44d4-a57e-e0aebfe7bea9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473909
May 26 14:58:55.614309 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:55.708673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7af93128-4556-494f-b8e5-c0460a0c6c8f req-d43cb470-586a-4cf4-b7d6-d4b3309b658d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:55.711118 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7af93128-4556-494f-b8e5-c0460a0c6c8f req-d43cb470-586a-4cf4-b7d6-d4b3309b658d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0948114
May 26 14:58:55.770574 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7af93128-4556-494f-b8e5-c0460a0c6c8f req-80f33f0e-c6e5-4547-be6a-1d0e42dbe4e0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0537081
May 26 14:58:56.128816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341fa731-fe13-46c7-a7a7-6a0e6c3473be req-1695e7cd-8b07-4293-a604-ae9493fdea5f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:56.130432 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-341fa731-fe13-46c7-a7a7-6a0e6c3473be req-1695e7cd-8b07-4293-a604-ae9493fdea5f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 943 time: 0.0833774
May 26 14:58:56.181503 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-341fa731-fe13-46c7-a7a7-6a0e6c3473be req-4e1489b7-03bb-46f6-a306-61ef3ee3a484 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0444469
May 26 14:58:56.418022 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-45505b5f-51f8-4d8c-beba-60caa7dc2142 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0700512
May 26 14:58:56.582364 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-809efd54-21e7-4578-a8c1-67b7f7131e8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:56.583833 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-809efd54-21e7-4578-a8c1-67b7f7131e8c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.0863848
May 26 14:58:56.735504 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-2241d07f-1de2-4c47-a58a-f4b32fa7af72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:56.736989 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-2241d07f-1de2-4c47-a58a-f4b32fa7af72 service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1290264
May 26 14:58:56.817050 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-dec1d3d0-5495-44be-a4ed-097c0622c781 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.0696692
May 26 14:58:56.898187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-63b58cca-9c40-4f3f-83b9-676b4d8273ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:56.899980 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-63b58cca-9c40-4f3f-83b9-676b4d8273ce service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.0714149
May 26 14:58:56.997621 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-43495b52-f410-425b-a197-1bd6a3724adc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0879016
May 26 14:58:57.153435 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152171c0-9da5-46d1-9ea2-dca086e9c23a req-a19c420c-2e68-4599-95d2-118d5462b550 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:57.155013 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-152171c0-9da5-46d1-9ea2-dca086e9c23a req-a19c420c-2e68-4599-95d2-118d5462b550 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1999819
May 26 14:58:57.199402 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-3ed3c6c5-18f4-44dc-839c-ebdbcd3c3e0f service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1772003
May 26 14:58:57.246773 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-152171c0-9da5-46d1-9ea2-dca086e9c23a req-f63a4a3f-cdd4-404d-9b5a-06d667cb95f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0726027
May 26 14:58:57.363705 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b7680a2f-74f7-4d95-910c-e3f1d650eb90 req-0dc05cb4-91c1-4878-9d78-571c2e8a6574 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1510119
May 26 14:58:57.413918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b555b4ac-4314-40a4-b970-36a1d1f7882a req-a626c2c2-f047-4d14-ae02-3d3c3722f176 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:57.415464 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b555b4ac-4314-40a4-b970-36a1d1f7882a req-a626c2c2-f047-4d14-ae02-3d3c3722f176 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 943 time: 0.0833781
May 26 14:58:57.461324 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b555b4ac-4314-40a4-b970-36a1d1f7882a req-8df195c9-0ae8-41cd-85a4-a1d924b9f243 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400777
May 26 14:58:57.567653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:58.294685 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5969b659-5456-4b6d-84cd-6a9fdbac70df details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:58:58.429936 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:58.460481 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '5969b659-5456-4b6d-84cd-6a9fdbac70df', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'port_id': '5969b659-5456-4b6d-84cd-6a9fdbac70df', 'mac_address': 'fa:16:3e:8d:90:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a5c1fbe6-787f-4fc0-9f39-1179f60b94a5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:58:58.460764 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3761c64-667d-456e-a406-bc2a08984ed6 req-fd1c6151-aad5-4b4c-9248-f3aaca72d424 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:58.460764 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3761c64-667d-456e-a406-bc2a08984ed6 req-fd1c6151-aad5-4b4c-9248-f3aaca72d424 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0860724
May 26 14:58:58.507919 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:58.517736 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3761c64-667d-456e-a406-bc2a08984ed6 req-903825b6-2828-4731-9f4a-a662d44e40b3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0486054
May 26 14:58:58.536579 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5969b659-5456-4b6d-84cd-6a9fdbac70df {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:58:58.553217 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:58:58.659575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:58:58.662426 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-8b863d7b-8d66-4092-ab1a-0f6fb75f652a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:58:58.734079 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:58:58.741679 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.745780 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 req-c0f4fb17-32da-49ba-b130-cb3348c8d47e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:58.746257 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.746257 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.746257 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.746573 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 req-c0f4fb17-32da-49ba-b130-cb3348c8d47e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 943 time: 0.1518204
May 26 14:58:58.746962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:58:58.751966 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:58:58.806232 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 req-dae2a5d3-f749-41a7-b9c9-aa8e0bf151df tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524671
May 26 14:58:59.038436 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:58:59.925102 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ac1d926-2190-4379-a729-6ac112cb1c4c req-0cbda398-e10e-4d6f-8359-e937f7ab831f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:58:59.927632 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5ac1d926-2190-4379-a729-6ac112cb1c4c req-0cbda398-e10e-4d6f-8359-e937f7ab831f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0870922
May 26 14:58:59.977488 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5ac1d926-2190-4379-a729-6ac112cb1c4c req-9460ad12-42dd-4caf-98b9-ac93bb1a90d9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443816
May 26 14:59:00.015385 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbb48355-133d-4c0c-b370-410a5f376ee3 req-18993a92-1b46-4956-8e49-766271531bbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:00.016957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbb48355-133d-4c0c-b370-410a5f376ee3 req-18993a92-1b46-4956-8e49-766271531bbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 944 time: 0.0880265
May 26 14:59:00.068381 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbb48355-133d-4c0c-b370-410a5f376ee3 req-189b7425-3069-4e01-aff5-7166f029bb25 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455709
May 26 14:59:00.526308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04fb1ddd-4d3f-4763-895b-13c4c91bf6ff req-719acf06-3986-4703-8cb2-967ffeb02d09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:00.528123 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04fb1ddd-4d3f-4763-895b-13c4c91bf6ff req-719acf06-3986-4703-8cb2-967ffeb02d09 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1099 time: 0.0823233
May 26 14:59:00.572517 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-04fb1ddd-4d3f-4763-895b-13c4c91bf6ff req-6a314c02-9db4-448a-a802-ccd01e5c1f6d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0366216
May 26 14:59:01.174206 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 req-935829fc-fa82-4fea-b7cd-5e9d8974eea2 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:01.174206 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 req-935829fc-fa82-4fea-b7cd-5e9d8974eea2 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0818424
May 26 14:59:01.218068 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 req-656ac55f-20d2-446a-b0b6-98541d4d0d03 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396447
May 26 14:59:01.274002 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2cb281-2975-4994-827f-954042adb480 req-391fa69b-69b3-4a88-8fc7-8804b00459df tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:01.274002 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b2cb281-2975-4994-827f-954042adb480 req-391fa69b-69b3-4a88-8fc7-8804b00459df tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 944 time: 0.0889189
May 26 14:59:01.323702 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b2cb281-2975-4994-827f-954042adb480 req-e5967b9e-369c-4709-b2e4-ff1b58dc1ec9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425775
May 26 14:59:01.880765 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56800) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:02.008483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.024664 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:02.028320 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Usage tracker for resource:security_group_rule and tenant:3a7d6e6ec8434539ae437dbc58cf7d8c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:02.031257 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:02.038303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:02.132886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.231172 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.240167 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-009b5a5a-d7cf-483e-8292-93235fc53ce4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:02.281495 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=3a7d6e6ec8434539ae437dbc58cf7d8c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3996150
May 26 14:59:02.283005 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9f3c558-0fe4-4e9b-a3a4-435ac1facb5f,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:02.284911 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56818) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:02.286489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:02.312147 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5969b659-5456-4b6d-84cd-6a9fdbac70df up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:02.349183 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.435697 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a72ea9-91b7-461d-9b88-7559ad7fdfef req-09fe5912-a12e-416d-848f-62ffe40eba36 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:02.437287 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-28a72ea9-91b7-461d-9b88-7559ad7fdfef req-09fe5912-a12e-416d-848f-62ffe40eba36 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1015460
May 26 14:59:02.460303 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 5969b659-5456-4b6d-84cd-6a9fdbac70df completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:02.466316 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 5969b659-5456-4b6d-84cd-6a9fdbac70df triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:02.466816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.484791 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.495955 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-28a72ea9-91b7-461d-9b88-7559ad7fdfef req-983e0e6a-08ac-4c13-87d0-929e8acd427d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489602
May 26 14:59:02.626589 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d req-c6a15367-051a-4edd-8f68-ebb2e437d0e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:02.627942 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d req-c6a15367-051a-4edd-8f68-ebb2e437d0e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 944 time: 0.1039526
May 26 14:59:02.635591 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.669635 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:02.673182 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.681528 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a83ced0e-add9-4e4d-8b3d-b6f09bda7a68 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:02.682234 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:02.700894 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d req-6593f35a-cf75-4fc9-940c-4ba1a54cae2a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0646226
May 26 14:59:02.702500 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9f3c558-0fe4-4e9b-a3a4-435ac1facb5f,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:02.705699 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:02.706699 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.710886 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c9f3c558-0fe4-4e9b-a3a4-435ac1facb5f HTTP/1.1" status: 204  len: 168 time: 0.4247868
May 26 14:59:02.749872 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b58d362e-785d-4161-9f85-bdc081e4bfa0 req-e725d453-7a14-45a2-9c8b-b34f7bce0681 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:02.751537 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b58d362e-785d-4161-9f85-bdc081e4bfa0 req-e725d453-7a14-45a2-9c8b-b34f7bce0681 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0938125
May 26 14:59:02.773273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:02.773273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:02.839189 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b58d362e-785d-4161-9f85-bdc081e4bfa0 req-853026ed-4343-446c-b933-b29618aa796a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0780985
May 26 14:59:02.853006 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df', 'code': 200}
May 26 14:59:02.887581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:02.892197 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:03.242475 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91d1f50d-8706-4bea-bf87-dda861d6a1b4 req-d0c22737-1779-4c6a-8486-0a89fc6ace1b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:03.244038 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-91d1f50d-8706-4bea-bf87-dda861d6a1b4 req-d0c22737-1779-4c6a-8486-0a89fc6ace1b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 1098 time: 0.0782933
May 26 14:59:03.293704 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-91d1f50d-8706-4bea-bf87-dda861d6a1b4 req-9674a76a-e23a-48de-96d2-8078d597eee4 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414572
May 26 14:59:03.787631 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56878) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:03.850344 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56886) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:03.932006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56894) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:03.998143 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Deleting subnet 2efb9823-ab44-4481-9508-a3571a81505e {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 14:59:04.004719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e36b443c-af94-4726-aa5e-3e4debe6e316 req-13a46fdd-aecd-442e-bdd9-ae927a1c807b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:04.005834 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e36b443c-af94-4726-aa5e-3e4debe6e316 req-13a46fdd-aecd-442e-bdd9-ae927a1c807b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.0935793
May 26 14:59:04.032783 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.055675 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e36b443c-af94-4726-aa5e-3e4debe6e316 req-d25268dc-d5e9-466e-8e67-b59d8b5d0a8d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433075
May 26 14:59:04.066655 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.085969 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.110881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:04.115297 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:04.121615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.149246 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Usage tracker for resource:security_group_rule and tenant:43575cbf5a93450099fc81ed13dea2b7 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:04.160794 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Usage tracker for resource:security_group_rule and tenant:60c71b0cdc2c47489ba0c541b984deb5 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:04.163521 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:04.175743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:04.176951 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:04.191981 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:04.243401 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.469609 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.567950 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.586789 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d85f6c6e-4b6e-4b56-9136-282b48415964 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:04.599539 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.639897 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=43575cbf5a93450099fc81ed13dea2b7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8511887
May 26 14:59:04.641279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae3b2b93-b618-456e-905e-ca2aea05ab94,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:04.643451 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56912) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:04.646380 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:04.652856 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56916) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:04.709785 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.722918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.731590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b96e272e-03b5-4a38-97f4-4c99aa119327 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:04.736892 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.775399 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1580454224-network', 'tenant_id': '5b729993a1944061bb0a708877c95a5c'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:04.779641 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.785796 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=60c71b0cdc2c47489ba0c541b984deb5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9342523
May 26 14:59:04.787724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:04.788853 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56922) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:04.795497 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=238551b8-8695-4724-a11a-95bdefdc4049,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:04.799145 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:04.800286 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Usage tracker for resource:network and tenant:5b729993a1944061bb0a708877c95a5c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:04.807370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:04.837809 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:04.849308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.851900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:04.853418 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.859024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2efb9823-ab44-4481-9508-a3571a81505e,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:04.862012 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:04.881020 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.882195 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-93cb31b3-f701-4c70-8830-1f04427f7d6a admin admin] 10.222.0.81 "DELETE /v2.0/subnets/2efb9823-ab44-4481-9508-a3571a81505e HTTP/1.1" status: 204  len: 168 time: 0.9490457
May 26 14:59:04.884764 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56926) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:04.917314 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.921170 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:04.931849 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae3b2b93-b618-456e-905e-ca2aea05ab94,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:04.934397 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:04.948280 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.948280 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/ae3b2b93-b618-456e-905e-ca2aea05ab94 HTTP/1.1" status: 204  len: 168 time: 0.2956531
May 26 14:59:04.981218 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Made reservation on behalf of 5b729993a1944061bb0a708877c95a5c for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:04.981218 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:04.997424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.029503 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:05.036235 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.037327 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.038985 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Usage tracker for resource:security_group_rule and tenant:5b729993a1944061bb0a708877c95a5c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:05.041958 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:05.042547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4dbf90df-0e3a-4421-9e7a-0072be4c1ff8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:05.051165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:05.056566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=238551b8-8695-4724-a11a-95bdefdc4049,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:05.058923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:05.066483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.072675 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/238551b8-8695-4724-a11a-95bdefdc4049 HTTP/1.1" status: 204  len: 168 time: 0.2783532
May 26 14:59:05.215425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.264676 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae req-617f2d86-9378-420c-b54d-fe68dde1c893 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:05.267044 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae req-617f2d86-9378-420c-b54d-fe68dde1c893 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.0817544
May 26 14:59:05.289406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.304285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4280d60>,) {'filters': {'network_id': ['a9824a3c-ffc1-4714-9231-01e04e6011f0']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:05.318064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4280d60>, '2bd9fcdf-68e4-455c-82b4-2c96cd936467') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:05.318441 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4280d60>, '2bd9fcdf-68e4-455c-82b4-2c96cd936467') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:05.322817 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae req-3f061a10-0706-456a-ae18-a0e7e542ce43 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490777
May 26 14:59:05.332024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.356220 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.360590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.363245 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fc9a43a6-6918-40fb-91f9-cd7210464030 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:05.385415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Releasing vlan 1238 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 14:59:05.385846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 14:59:05.402393 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 14:59:05.417952 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1220}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:59:05.551458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63b52cba-73eb-4a19-a99c-4bdf00795972,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:05.572112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:05.578595 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.579586 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Added segment 324ba4e6-313b-4b92-81fd-29df319c25e1 of type vlan for network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298
May 26 14:59:05.724033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56956) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:05.732302 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.763842 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.769911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:05.785769 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.800523 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Pushing event deleted for resources: {'Network': ['ID=a9824a3c-ffc1-4714-9231-01e04e6011f0,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:05.803877 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:05.815226 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:05.817005 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:05.828327 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Usage tracker for resource:security_group_rule and tenant:97db76196a32443eabb6d085ea7c817b is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:05.847364 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:05.849326 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] 10.222.0.81 "DELETE /v2.0/networks/a9824a3c-ffc1-4714-9231-01e04e6011f0 HTTP/1.1" status: 204  len: 168 time: 0.9635849
May 26 14:59:05.852068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56962) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:05.856878 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:05.891973 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-bc2e8b34-618a-43ac-b6ba-07b190d57378 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:05.893738 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-bc2e8b34-618a-43ac-b6ba-07b190d57378 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.1419988
May 26 14:59:05.922571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e req-839e597f-ed0d-4ff6-b295-8de5edd6559a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:05.924062 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e req-839e597f-ed0d-4ff6-b295-8de5edd6559a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2480814
May 26 14:59:05.929384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Deleting subnet 948466e0-84bf-4a37-a671-3629d6052665 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 14:59:05.945384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.024100 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.052829 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e req-84e4c8f8-fe6c-47af-a97b-368164c5f192 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1211774
May 26 14:59:06.057865 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.065065 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:06.065671 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.070961 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:06.088258 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.097090 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-6f24d8f0-faac-478f-a0a3-778c19065c2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:06.098775 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-6f24d8f0-faac-478f-a0a3-778c19065c2c service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1951387
May 26 14:59:06.174061 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-c97fefc2-ee16-4862-8754-523220e5b5d4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.0671737
May 26 14:59:06.181589 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.208238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Pushing event updated for resources: {'Network': ['ID=9f5bc9eb-1964-454a-a177-4bdcfc4e0298,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:06.214728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:06.219286 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:59:06.222466 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.226876 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.5727301
May 26 14:59:06.231247 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56968) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:06.236931 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4cca726a-fb90-47be-b2d7-a0ae4837112a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:06.239294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Request body: {'subnet': {'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1580454224-subnet', 'tenant_id': '5b729993a1944061bb0a708877c95a5c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:06.266760 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:06.277967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Usage tracker for resource:subnet and tenant:5b729993a1944061bb0a708877c95a5c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:06.293781 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=97db76196a32443eabb6d085ea7c817b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5680506
May 26 14:59:06.297207 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 56974) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:06.306690 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=299c1bb4-1ff5-4f57-99a8-bb0191220fa0,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:06.311486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-8f00be16-7931-49e0-b545-f030acc5e4db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:06.312943 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-8f00be16-7931-49e0-b545-f030acc5e4db service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.1315074
May 26 14:59:06.331079 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:06.352209 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:06.375094 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:06.415657 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-956416ce-edfb-44c9-8265-efe90919f805 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0602670
May 26 14:59:06.494960 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Made reservation on behalf of 5b729993a1944061bb0a708877c95a5c for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:06.497194 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.518494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.571483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.697314 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-7996bbed-c532-40b7-ae95-6df7152aeef4 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2716682
May 26 14:59:06.758102 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.763906 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:06.806193 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.807775 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=948466e0-84bf-4a37-a671-3629d6052665,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:06.813202 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:06.817409 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-13efea23-2375-4e21-8c02-794d5795847b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:06.818527 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.831475 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/948466e0-84bf-4a37-a671-3629d6052665 HTTP/1.1" status: 204  len: 168 time: 0.9745991
May 26 14:59:06.831475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 56996) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:06.836614 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=299c1bb4-1ff5-4f57-99a8-bb0191220fa0,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:06.851951 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:06.855286 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:06.856402 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/299c1bb4-1ff5-4f57-99a8-bb0191220fa0 HTTP/1.1" status: 204  len: 168 time: 0.5541377
May 26 14:59:06.904032 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c24f080-190d-4303-8b5f-6b6358b6c98d req-b445f5f6-615c-4020-ab82-c490130cf6c5 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1979160
May 26 14:59:06.990365 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.152949 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.166251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac430cf40>,) {'filters': {'network_id': ['98b875f8-86e8-4b25-ba8a-587bb370c050']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:07.178770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac430cf40>, '01f9b25f-0bf6-4e00-b951-96b5f3242baa') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:07.179065 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac430cf40>, '01f9b25f-0bf6-4e00-b951-96b5f3242baa') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:07.203132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.226408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.245927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b21bae7-d75e-4ef1-8642-7e583b6de518 req-f64e8485-0161-4928-aaa0-7be669274a15 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:07.251654 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b21bae7-d75e-4ef1-8642-7e583b6de518 req-f64e8485-0161-4928-aaa0-7be669274a15 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0807254
May 26 14:59:07.290440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Releasing vlan 1204 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 14:59:07.290440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.302669 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b21bae7-d75e-4ef1-8642-7e583b6de518 req-2cd4dc51-fc7d-4495-a969-726cd428a4a4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485413
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 14:59:07.306411 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 14:59:07.551417 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.560633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:07.575387 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.588204 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Pushing event deleted for resources: {'Network': ['ID=98b875f8-86e8-4b25-ba8a-587bb370c050,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:07.590175 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:07.594240 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-6f7ba8f7-756f-46ff-82a5-fa60187785c8 admin admin] 10.222.0.81 "DELETE /v2.0/networks/98b875f8-86e8-4b25-ba8a-587bb370c050 HTTP/1.1" status: 204  len: 168 time: 0.7591417
May 26 14:59:07.594240 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:07.600406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ec305053-162f-4c3b-b089-087dc8bd4e5f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:07.679928 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bdad3913-e712-409a-9b8b-ccdccd8ad915,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:07.683595 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:07.690073 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Checking segment: {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:07.690429 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Network hostable DHCP agents. Network: 9f5bc9eb-1964-454a-a177-4bdcfc4e0298, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:59:07.824428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:59:07.944289 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 9f5bc9eb-1964-454a-a177-4bdcfc4e0298) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:07.956779 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26a2af0f-32f1-4f95-a451-bb3dc340649d None None] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:07.957308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:07.957905 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:08.044199 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57040) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:08.098094 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-ce0d950d-814a-446d-bc8a-503d0f358b66 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=be67b3bbd52c4c3f8e955c9ce1c5855e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0525439
May 26 14:59:08.100401 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57044) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:08.162749 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.9198744
May 26 14:59:08.167117 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-540368c5-b9c0-4cd4-9a80-6a2ec37504c8 None None] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:08.246268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:08.274365 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:08.472465 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:08.478034 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-418e6f53-781d-4d44-bf8b-76203f7413f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:08.492002 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b6f41d2-da34-4d2c-b4e2-12c554b2dade,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:08.503284 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:08.509840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:08.513605 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4b6f41d2-da34-4d2c-b4e2-12c554b2dade HTTP/1.1" status: 204  len: 168 time: 0.4120762
May 26 14:59:08.552408 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deff40-6589-4730-88e3-7df1d7f044e3 req-08e44482-8eb0-4e04-bdd7-ddaf9fb1f7fd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:08.556678 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d3deff40-6589-4730-88e3-7df1d7f044e3 req-08e44482-8eb0-4e04-bdd7-ddaf9fb1f7fd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1357052
May 26 14:59:08.603152 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d3deff40-6589-4730-88e3-7df1d7f044e3 req-2506f497-64ca-41d9-81f4-e94f934f4c8a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418365
May 26 14:59:09.144979 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-00e4161b-f890-495c-bfbf-21510ef7e35b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/networks?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0330038
May 26 14:59:09.278634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 57094) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:09.322690 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-bb562056-c8e4-4545-b181-5764066be264 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:09.324292 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-bb562056-c8e4-4545-b181-5764066be264 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1733966
May 26 14:59:09.340378 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-a30920f4-8b37-41c8-986d-f7be4b1f4d64 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/quotas/5a4d985046c34c1eb9e28915d7ebb5b5 HTTP/1.1" status: 200  len: 375 time: 0.0098348
May 26 14:59:09.394775 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-f2c763d1-54da-4f37-b7eb-5562335adcf0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0463824
May 26 14:59:09.423662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.435980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:09.440605 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Usage tracker for resource:security_group_rule and tenant:33c104d23de047c6bbbc1911668aebe8 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:09.443983 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:09.450305 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:09.496811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57104) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:09.552678 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.553457 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-195ba289-1285-4ed5-a4d5-8faaae3ea54e admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bfd47b2be803402bbd63197e7de29d49&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0552580
May 26 14:59:09.555929 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57108) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:09.615987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.643454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.649567 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.664510 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a0e754d8-c555-4968-9c95-add01f07112a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:09.736987 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=33c104d23de047c6bbbc1911668aebe8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4572558
May 26 14:59:09.768750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57118) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:09.772902 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a49f1c6-8852-4b4d-8295-9c2f05cbd7a5,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:09.781399 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:09.789770 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2369035b-6d78-42f5-adcb-46209d3adc7c req-9c274517-ccad-4bc2-8ef4-4a40f6b52b00 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 210 time: 0.0579059
May 26 14:59:09.820158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.826860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-55eea403-8e0e-4b83-ba0e-d9eec0a97b23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:09.844150 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf7ec22d-2f1e-4b6b-8c35-5466cb4f3397,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:09.848455 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:09.849833 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d150012-7c3d-4909-bd6b-9088038982ea req-35cba971-7e41-4b3e-966f-5c2c71e1f066 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:09.857601 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2d150012-7c3d-4909-bd6b-9088038982ea req-35cba971-7e41-4b3e-966f-5c2c71e1f066 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1291409
May 26 14:59:09.860571 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.863947 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/cf7ec22d-2f1e-4b6b-8c35-5466cb4f3397 HTTP/1.1" status: 204  len: 168 time: 0.3048398
May 26 14:59:09.873158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.904659 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:09.914086 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2d150012-7c3d-4909-bd6b-9088038982ea req-a451bb8a-bf23-4b67-9609-6d3b3a805ba7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553751
May 26 14:59:10.088432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:10.094167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:10.109255 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a49f1c6-8852-4b4d-8295-9c2f05cbd7a5,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:10.112668 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:10.113777 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/9a49f1c6-8852-4b4d-8295-9c2f05cbd7a5 HTTP/1.1" status: 204  len: 168 time: 0.3447084
May 26 14:59:10.117496 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:10.905032 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1663fce1-e6c7-41c2-811a-a089548b9db3 req-96a54dc6-0fde-412a-8d91-ac54563bbb67 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 210 time: 0.0504394
May 26 14:59:10.916578 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-a76526aa-abe4-437e-8070-354bb1ea092d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:10.918061 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-a76526aa-abe4-437e-8070-354bb1ea092d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/networks?id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298 HTTP/1.1" status: 200  len: 814 time: 0.1594274
May 26 14:59:10.939929 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-7650d721-ae7b-415e-b8a6-35e4604ff2e2 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/quotas/5b729993a1944061bb0a708877c95a5c HTTP/1.1" status: 200  len: 375 time: 0.0130699
May 26 14:59:10.987964 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-a31c7d7a-f990-4752-85cb-baa258130602 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0422225
May 26 14:59:11.113515 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 req-cc6263c5-2dda-4ea5-a127-a0a5d2d031ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:11.115029 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 req-cc6263c5-2dda-4ea5-a127-a0a5d2d031ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0923910
May 26 14:59:11.134474 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-5faf8aeb-119c-49c1-844f-da9ac7d3aea5 service neutron] 10.222.0.81 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1395380
May 26 14:59:11.178942 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 req-7d13c827-7338-4cff-a2ae-8b28bfc99a91 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0556946
May 26 14:59:11.307310 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3c6d4182-8ddc-4710-9381-f48f2aa41899 service neutron] 10.222.0.81 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1657951
May 26 14:59:11.586760 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-026b4e02-66dc-49d3-a15b-4d9decd9866b req-5ba50913-a60e-47ea-b478-5d3dcd1b82e1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0548532
May 26 14:59:12.058699 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 req-91eebddc-7218-4d1a-b52c-f0877826dc85 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 210 time: 0.0483429
May 26 14:59:12.417156 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-d487e2ea-21a0-4db5-90fb-344da82b02ce tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.32 "GET /v2.0/networks?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0501442
May 26 14:59:12.425412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8dfd318-bed6-4625-9b58-d8a80e913f70 req-4ca04856-9ffd-4e36-b5d2-5d089052b466 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:12.426949 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e8dfd318-bed6-4625-9b58-d8a80e913f70 req-4ca04856-9ffd-4e36-b5d2-5d089052b466 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1462259
May 26 14:59:12.495717 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e8dfd318-bed6-4625-9b58-d8a80e913f70 req-a76fd089-94ab-4981-a894-f14749d702e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0631576
May 26 14:59:12.591057 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-1bc4b14e-ff51-485e-bc51-7cda49daab88 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:12.593879 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-1bc4b14e-ff51-485e-bc51-7cda49daab88 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.1714225
May 26 14:59:12.614584 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Request body: {'port': {'device_id': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d', 'admin_state_up': True, 'tenant_id': '5a4d985046c34c1eb9e28915d7ebb5b5'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:12.754817 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:12.758953 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-89001f39-4d58-4736-983e-fa410e009fa4 req-0b58afbf-0c41-44a0-ab96-25719e11af7e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0614874
May 26 14:59:12.759119 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Usage tracker for resource:port and tenant:5a4d985046c34c1eb9e28915d7ebb5b5 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:12.761906 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Quota usage for port was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:12.769508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:12.830904 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Made reservation on behalf of 5a4d985046c34c1eb9e28915d7ebb5b5 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:12.834394 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:12.848417 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:12.863651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:12.867706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Usage tracker for resource:security_group_rule and tenant:5a4d985046c34c1eb9e28915d7ebb5b5 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:12.870575 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:12.876320 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:12.959339 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:13.020319 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:13.023577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:13.216266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Pushing event updated for resources: {'SecurityGroup': ['ID=abb7dcdf-8b15-4853-85c1-449e65d9fcea,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:13.233219 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.210s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:13.238048 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-33f49f79-1b6e-4ce9-9f94-e72778255a82 req-bcc1e7f2-2d7d-4e0f-9d51-3899fa434032 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 210 time: 0.0579031
May 26 14:59:13.286367 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:59:13.320558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Allocated IP 192.168.233.14 (acf7e4b9-87b3-4e48-b7f3-29816212960d/11ad92d2-48d9-4f94-96d6-0af955f646ce/af4a6c11-6609-4623-bb2f-1fecb6f3099a) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:13.543234 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:13.560080 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Transition to ACTIVE for port object af4a6c11-6609-4623-bb2f-1fecb6f3099a will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:13.668844 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:13.678683 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:13.746225 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Network acf7e4b9-87b3-4e48-b7f3-29816212960d is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:13.751266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:13.756059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:13.798304 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Pushing event updated for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:13.817807 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0083d27-5e66-482f-a8be-dc98284e83b1 req-841819c9-60d8-41d7-8a57-a0a71c1684ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:13.819398 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a0083d27-5e66-482f-a8be-dc98284e83b1 req-841819c9-60d8-41d7-8a57-a0a71c1684ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2129991
May 26 14:59:13.822939 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:13.870277 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:13.871474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:13.896569 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a0083d27-5e66-482f-a8be-dc98284e83b1 req-624a7134-fc17-44f6-89ff-89d3dbdee208 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0690577
May 26 14:59:13.962321 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f req-6f710779-83c6-4100-b4eb-9b54a580fa1b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0479939
May 26 14:59:13.975108 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 937 time: 1.3650966
May 26 14:59:14.000364 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Request body: {'port': {'device_id': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:14.120217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.150114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-bd471d27-c241-4c09-b86a-e064b7837490 None None] Provisioning for port af4a6c11-6609-4623-bb2f-1fecb6f3099a completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:14.155651 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-bd471d27-c241-4c09-b86a-e064b7837490 None None] Provisioning complete for port af4a6c11-6609-4623-bb2f-1fecb6f3099a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:14.155960 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-859cdbd3-d410-4bce-85da-ac034147c643 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:14.156087 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd471d27-c241-4c09-b86a-e064b7837490 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.156705 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-859cdbd3-d410-4bce-85da-ac034147c643 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:network {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:14.225022 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-bd471d27-c241-4c09-b86a-e064b7837490 None None] Port af4a6c11-6609-4623-bb2f-1fecb6f3099a cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 14:59:14.231438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-859cdbd3-d410-4bce-85da-ac034147c643 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:network {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:14.232880 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-859cdbd3-d410-4bce-85da-ac034147c643 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "GET /v2.0/networks?id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298 HTTP/1.1" status: 200  len: 814 time: 0.2365758
May 26 14:59:14.248883 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Request body: {'port': {'device_id': '990431e1-82cb-42b0-a288-949d79e21762', 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298', 'admin_state_up': True, 'tenant_id': '5b729993a1944061bb0a708877c95a5c'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:14.395953 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:14.399831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Usage tracker for resource:port and tenant:5b729993a1944061bb0a708877c95a5c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:14.405478 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Quota usage for port was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:14.410273 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:14.502613 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-394abe5b-fa60-443b-bacb-c7a0db877dc8 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:14.503316 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-394abe5b-fa60-443b-bacb-c7a0db877dc8 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Synchronizing usage tracker for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:14.517288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Made reservation on behalf of 5b729993a1944061bb0a708877c95a5c for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:14.520813 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.583729 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id af4a6c11-6609-4623-bb2f-1fecb6f3099a {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:14.591212 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.606656 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Transition to ACTIVE for port object af4a6c11-6609-4623-bb2f-1fecb6f3099a will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:14.648400 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-394abe5b-fa60-443b-bacb-c7a0db877dc8 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Unset dirty status for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:14.649640 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-394abe5b-fa60-443b-bacb-c7a0db877dc8 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 935 time: 0.2861354
May 26 14:59:14.699845 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-d76fd329-26bc-400d-a246-7f5236d21443 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Synchronizing usage tracker for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:14.702900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Allocated IP 172.20.0.10 (9f5bc9eb-1964-454a-a177-4bdcfc4e0298/bdad3913-e712-409a-9b8b-ccdccd8ad915/6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:14.703241 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.718362 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:14.837711 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-d76fd329-26bc-400d-a246-7f5236d21443 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Unset dirty status for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:14.838874 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee req-d76fd329-26bc-400d-a246-7f5236d21443 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1826262
May 26 14:59:14.851747 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Pushing event updated for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:14.886866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:14.948374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:14.976982 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Attempting to bind port af4a6c11-6609-4623-bb2f-1fecb6f3099a on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:14.977321 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Attempting to bind port af4a6c11-6609-4623-bb2f-1fecb6f3099a by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:14.977772 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Attempting to bind port af4a6c11-6609-4623-bb2f-1fecb6f3099a on network acf7e4b9-87b3-4e48-b7f3-29816212960d {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:14.982665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Port af4a6c11-6609-4623-bb2f-1fecb6f3099a on network acf7e4b9-87b3-4e48-b7f3-29816212960d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:59:14.982974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Attempting to bind port af4a6c11-6609-4623-bb2f-1fecb6f3099a on network acf7e4b9-87b3-4e48-b7f3-29816212960d {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:14.988289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 58, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:14.988634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Checking segment: {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:14.989014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Bound using segment: {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:14.989439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Bound port: af4a6c11-6609-4623-bb2f-1fecb6f3099a, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1f795401-233e-4b1b-a86a-8738ee2a8006', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1249, 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:14.989824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:15.077218 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:15.082138 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:15.085099 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:15.085229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:15.145125 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:15.148121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:15.152246 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:15.196378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Pushing event updated for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:15.197661 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:15.201173 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:15.201707 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:15.222565 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:15.223176 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:15.261818 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:15.262406 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:15.263777 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] 10.222.0.32 "PUT /v2.0/ports/af4a6c11-6609-4623-bb2f-1fecb6f3099a HTTP/1.1" status: 200  len: 1097 time: 1.2679086
May 26 14:59:15.264238 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:15.283283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Pushing event updated for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:15.286464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:15.322394 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.0781481
May 26 14:59:17.857053 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Request body: {'port': {'device_id': '990431e1-82cb-42b0-a288-949d79e21762', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:18.096445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:18.178795 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-9bdbaf21-fce8-45ce-b0bf-a71a4a74293c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.180178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 req-786ec7d6-2f0f-4c21-b98b-6191d17b35e8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.180330 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-9bdbaf21-fce8-45ce-b0bf-a71a4a74293c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 1100 time: 0.2239721
May 26 14:59:18.181643 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 req-786ec7d6-2f0f-4c21-b98b-6191d17b35e8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2356813
May 26 14:59:18.188666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 req-bfc87bfc-8306-44cf-b02b-e38e68df0ec0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.190589 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 req-bfc87bfc-8306-44cf-b02b-e38e68df0ec0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 932 time: 0.1146059
May 26 14:59:18.269949 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-ea6220a6-7e03-4d3f-8446-e771e3a038a5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.14&port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a HTTP/1.1" status: 200  len: 217 time: 0.0783813
May 26 14:59:18.292703 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 req-9498412f-197c-4178-a5a4-d7bde9c295d5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1016884
May 26 14:59:18.327261 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 req-38019db4-42a6-4ffc-bf17-236aa25bd587 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0880866
May 26 14:59:18.349582 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a', 'status': 'completed', 'code': 200}
May 26 14:59:18.355027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-be5df443-1762-4914-a5d6-60eb85ae0693 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.356469 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-be5df443-1762-4914-a5d6-60eb85ae0693 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=11ad92d2-48d9-4f94-96d6-0af955f646ce HTTP/1.1" status: 200  len: 843 time: 0.0678678
May 26 14:59:18.453025 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-60ed309f-ce6a-4acf-a616-d1c84e1107d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.455171 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-60ed309f-ce6a-4acf-a616-d1c84e1107d1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=acf7e4b9-87b3-4e48-b7f3-29816212960d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0838943
May 26 14:59:18.508651 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:18.519303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:18.540862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Transition to ACTIVE for port object 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:18.606587 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-2274cbf9-0766-4a54-8284-214ed62a5370 service neutron] 10.222.0.32 "GET /v2.0/networks/acf7e4b9-87b3-4e48-b7f3-29816212960d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1409888
May 26 14:59:18.630922 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a54cfef-4239-4ac5-801f-e271de1f5a1f req-2a81200e-6658-41dc-89fe-cfde09184c4b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:18.632363 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9a54cfef-4239-4ac5-801f-e271de1f5a1f req-2a81200e-6658-41dc-89fe-cfde09184c4b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 947 time: 0.1160851
May 26 14:59:18.633702 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:18.638463 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:18.742825 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1e1deb19-0520-4518-a40b-b18d2182a8a2 req-cdcde014-bb94-4dae-aace-8f8cffe76760 service neutron] 10.222.0.32 "GET /v2.0/networks/acf7e4b9-87b3-4e48-b7f3-29816212960d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1277037
May 26 14:59:18.794673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Pushing event updated for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:18.800562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:18.803728 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9a54cfef-4239-4ac5-801f-e271de1f5a1f req-63b00d6b-2aab-4314-8766-278d05609c8e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1361804
May 26 14:59:18.909998 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Attempting to bind port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:18.910726 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Attempting to bind port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:18.911967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Attempting to bind port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:18.916916 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:59:18.917229 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Attempting to bind port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:18.922457 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 58, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:18.922778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Checking segment: {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:18.923153 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Bound using segment: {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:18.924681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Bound port: 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:18.924681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:19.005825 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-6d222463-5967-4680-bfe4-2534094283f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.007357 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-6d222463-5967-4680-bfe4-2534094283f3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 1100 time: 0.0847309
May 26 14:59:19.020068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:19.020614 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:19.129039 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:19.134072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98ad6a04-c47c-4db0-8a21-70894a7df9f6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:19.146930 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-18251e7d-3382-4ab9-98ce-2758a519ec6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.148379 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-18251e7d-3382-4ab9-98ce-2758a519ec6f service neutron] 10.222.0.32 "GET /v2.0/networks?id=acf7e4b9-87b3-4e48-b7f3-29816212960d HTTP/1.1" status: 200  len: 871 time: 0.1316550
May 26 14:59:19.195965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.196576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:19.197968 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] 10.222.0.32 "PUT /v2.0/ports/6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 HTTP/1.1" status: 200  len: 1094 time: 1.3481185
May 26 14:59:19.198483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:19.219796 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Pushing event updated for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:19.223772 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:19.230197 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-31a7a6bb-316c-4833-96c0-28df23863daf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.14&port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a HTTP/1.1" status: 200  len: 217 time: 0.0709727
May 26 14:59:19.258133 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15', 'status': 'completed', 'code': 200}
May 26 14:59:19.301114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-f6093c8f-d1f6-4bc7-b861-5f29e169fe1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.302564 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-f6093c8f-d1f6-4bc7-b861-5f29e169fe1c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=11ad92d2-48d9-4f94-96d6-0af955f646ce HTTP/1.1" status: 200  len: 843 time: 0.0652022
May 26 14:59:19.357666 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ae1aebde-cfae-4cc7-8262-c7ec932e593e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.359191 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ae1aebde-cfae-4cc7-8262-c7ec932e593e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 1097 time: 0.0732923
May 26 14:59:19.393415 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-75d21019-0e1e-4533-a08b-60a66a7e89c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.396188 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-75d21019-0e1e-4533-a08b-60a66a7e89c6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=acf7e4b9-87b3-4e48-b7f3-29816212960d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.0835571
May 26 14:59:19.573119 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82784baf-5e43-473f-87bc-6892f0b83271 req-112896f5-c792-4e9f-be1d-35ab086ac795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.574604 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-82784baf-5e43-473f-87bc-6892f0b83271 req-112896f5-c792-4e9f-be1d-35ab086ac795 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=5b729993a1944061bb0a708877c95a5c&shared=False HTTP/1.1" status: 200  len: 916 time: 0.2068899
May 26 14:59:19.593594 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-06c5fb2c-ed81-448a-a4f9-f987a1fd8f58 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.595988 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-06c5fb2c-ed81-448a-a4f9-f987a1fd8f58 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:19.621693 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67dc669b-5493-4616-8b86-76e33f998ffc req-6013b2b0-0aa7-4673-ad04-759fedfa0460 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:19.623124 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67dc669b-5493-4616-8b86-76e33f998ffc req-6013b2b0-0aa7-4673-ad04-759fedfa0460 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1876504
May 26 14:59:19.625038 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-34c3c28d-9074-4ed7-9a37-f818e56a3f43 service neutron] 10.222.0.32 "GET /v2.0/networks/acf7e4b9-87b3-4e48-b7f3-29816212960d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2162590
May 26 14:59:19.667962 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67dc669b-5493-4616-8b86-76e33f998ffc req-f52ac647-fd6e-4c48-a1d8-b04c1ff28190 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0384643
May 26 14:59:19.676913 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-06c5fb2c-ed81-448a-a4f9-f987a1fd8f58 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:19.678108 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-06c5fb2c-ed81-448a-a4f9-f987a1fd8f58 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.2069817
May 26 14:59:19.722781 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-9f72d6a9-2ebe-4f4f-8a98-29c9b1f6bb91 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:19.779225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-9f72d6a9-2ebe-4f4f-8a98-29c9b1f6bb91 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:19.780339 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-19724d3f-d2ff-48da-801b-b219e685b7ea req-9f72d6a9-2ebe-4f4f-8a98-29c9b1f6bb91 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0966403
May 26 14:59:19.998974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9cf6628-d7cd-44b7-b697-ec275b968489 req-304fcdab-b4f8-425b-b1e2-d9ada93c6e9f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:20.000927 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9cf6628-d7cd-44b7-b697-ec275b968489 req-304fcdab-b4f8-425b-b1e2-d9ada93c6e9f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 947 time: 0.0842681
May 26 14:59:20.070236 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9cf6628-d7cd-44b7-b697-ec275b968489 req-f39b9474-83bf-4c03-a61e-561a4ecf28fa tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0633783
May 26 14:59:20.422112 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-97043f27-7701-4cb9-bc4f-e48e871cd2b0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:20.424523 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-97043f27-7701-4cb9-bc4f-e48e871cd2b0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.1438987
May 26 14:59:20.440816 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-1b1988db-1e0b-4f42-bc6b-89a06237bc81 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/quotas/1515325707f64d58a28f26451b2c74de HTTP/1.1" status: 200  len: 375 time: 0.0103679
May 26 14:59:20.505454 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-566b0880-f01c-4615-b521-ce5532469a7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:20.593837 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-afa6e416-a414-4161-bf60-d0b88aa992d7 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1475744
May 26 14:59:20.727028 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-16eb2f73-b7a9-4095-b56f-795f7fe83421 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265879
May 26 14:59:20.863290 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ff823a04-1d66-4aca-b832-ba4d753662f8 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302631
May 26 14:59:21.244707 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bca7322-5e17-4f76-b15b-442774951d07 req-d9c0ccb7-9815-4982-b9fb-784fe523aedf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:21.246202 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bca7322-5e17-4f76-b15b-442774951d07 req-d9c0ccb7-9815-4982-b9fb-784fe523aedf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0927134
May 26 14:59:21.290708 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bca7322-5e17-4f76-b15b-442774951d07 req-025e19a4-b92c-4735-8f39-d8ed8035d666 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387206
May 26 14:59:21.461554 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d req-b57fc627-23bd-46a1-9c71-05a59a7ee670 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:21.463164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d req-b57fc627-23bd-46a1-9c71-05a59a7ee670 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.0812926
May 26 14:59:21.508891 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d req-57ab1abe-810e-4bb0-9d64-a36932321ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400217
May 26 14:59:21.598725 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-85ac7bc3-ec3e-49f3-8f0f-d6f013b31415 req-2fa06437-540c-4646-bc10-51e0c34c2a37 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 210 time: 0.0481369
May 26 14:59:21.769730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1483af-526b-4969-aba7-1ce1801e5660 req-fdd2b4a5-b88b-4860-8074-c56975899b34 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:21.771195 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da1483af-526b-4969-aba7-1ce1801e5660 req-fdd2b4a5-b88b-4860-8074-c56975899b34 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 947 time: 0.0808456
May 26 14:59:21.818496 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da1483af-526b-4969-aba7-1ce1801e5660 req-9fe70ac0-3c57-43b4-bdc3-ca9ffaa84102 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408399
May 26 14:59:22.492197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc0a129-c79f-463a-a65e-101df12c5230 req-6c0afa67-8091-4af5-a2ee-a4261a266dc3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:22.493584 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5dc0a129-c79f-463a-a65e-101df12c5230 req-6c0afa67-8091-4af5-a2ee-a4261a266dc3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0835807
May 26 14:59:22.538180 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5dc0a129-c79f-463a-a65e-101df12c5230 req-82a4cb3b-09aa-4b5b-87bd-0da0f7ea66f7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390053
May 26 14:59:22.708317 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b37afa09-9551-4cc7-b24a-477e978611ad req-c66c154c-c012-4870-90f2-59f5ed890104 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:22.709822 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b37afa09-9551-4cc7-b24a-477e978611ad req-c66c154c-c012-4870-90f2-59f5ed890104 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.0819471
May 26 14:59:22.754777 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b37afa09-9551-4cc7-b24a-477e978611ad req-9fcedcd8-3909-48b6-9e11-d22cbd0f5fd4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380926
May 26 14:59:22.905813 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82784baf-5e43-473f-87bc-6892f0b83271 req-467ceb8e-3168-4542-8da1-dbd6f73ded55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:22.908712 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-82784baf-5e43-473f-87bc-6892f0b83271 req-467ceb8e-3168-4542-8da1-dbd6f73ded55 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1492748
May 26 14:59:22.928094 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-dca459b5-2610-47c4-8de0-40ebce8ceed1 req-01443b4e-8e8e-422c-8d79-2db94a41e3c5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 210 time: 0.0515640
May 26 14:59:22.973644 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-232fcf10-7656-4be8-9ba1-dd89b8dcedea service neutron] 10.222.0.32 "GET /v2.0/networks/acf7e4b9-87b3-4e48-b7f3-29816212960d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2068267
May 26 14:59:23.094119 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:23.119359 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-017b83fa-e593-4ce1-9103-2195acf95a2f req-d4829d45-ca7e-4ecb-8a01-2d0b7e1e7277 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:23.120771 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-017b83fa-e593-4ce1-9103-2195acf95a2f req-d4829d45-ca7e-4ecb-8a01-2d0b7e1e7277 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 947 time: 0.1142292
May 26 14:59:23.123358 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-d4550791-c17a-4a57-8f60-383c4922ee0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:23.124663 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-d4550791-c17a-4a57-8f60-383c4922ee0d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 1097 time: 0.1511548
May 26 14:59:23.173492 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-fcc8235a-4e7f-4a2b-89e5-b455c7a9f7eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:23.279937 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-ef3c9ea9-942b-424c-9284-7deff763da71 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 HTTP/1.1" status: 200  len: 217 time: 0.1392543
May 26 14:59:23.300546 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-017b83fa-e593-4ce1-9103-2195acf95a2f req-68a384fd-02dd-4278-8268-94d103fa8ae5 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1739376
May 26 14:59:23.355976 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-9eb35d05-3ed6-48a7-b532-ea02d55d1717 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:23.357284 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-9eb35d05-3ed6-48a7-b532-ea02d55d1717 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=bdad3913-e712-409a-9b8b-ccdccd8ad915 HTTP/1.1" status: 200  len: 854 time: 0.0603092
May 26 14:59:23.407019 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-118860cb-9936-4553-a7d1-badd74bdbfd1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0429790
May 26 14:59:23.557155 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-c25177a1-ee89-479f-886d-99349ea27622 service neutron] 10.222.0.32 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1309609
May 26 14:59:23.693680 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2e3ffd02-0eff-4d6e-8897-75752a308efb req-5025a71e-bb84-4998-b31a-f2b54024c05f service neutron] 10.222.0.32 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285024
May 26 14:59:23.730162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e472f9-c741-4943-a7b7-f1921c9b62bf req-13aa51cf-6bf1-4a6a-befd-1576ea9bbf03 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:23.731658 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9e472f9-c741-4943-a7b7-f1921c9b62bf req-13aa51cf-6bf1-4a6a-befd-1576ea9bbf03 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0837791
May 26 14:59:23.780491 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9e472f9-c741-4943-a7b7-f1921c9b62bf req-15b20048-aeda-4399-a07b-c772ef80245d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425217
May 26 14:59:23.945261 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3971be24-cefd-4b77-b319-ac9d9152b730 req-0e7bd05b-f053-4830-9101-9425582d155b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:23.946938 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3971be24-cefd-4b77-b319-ac9d9152b730 req-0e7bd05b-f053-4830-9101-9425582d155b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.0830648
May 26 14:59:24.002648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3971be24-cefd-4b77-b319-ac9d9152b730 req-da6c2bc6-ad12-4533-8c9a-cf60a3b72cec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0482721
May 26 14:59:24.048586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:24.092801 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ba5cd242-0ced-410c-b5f7-66dda03078e8 req-d6cc2f5e-c491-4b2f-8901-58a94ca94eee tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 210 time: 0.0431256
May 26 14:59:24.262817 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ec8b6d30-c1f8-408f-8d2f-a7b8542035c0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:24.264354 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ec8b6d30-c1f8-408f-8d2f-a7b8542035c0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.1495297
May 26 14:59:24.288248 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Request body: {'port': {'device_id': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'admin_state_up': True, 'tenant_id': '1515325707f64d58a28f26451b2c74de'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:24.430985 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:24.440787 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:24.494730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96ec967-45a2-4438-b854-7cfb2ec9459e req-b60f389b-dba2-4493-816c-1b7bc99cb35d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:24.496083 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c96ec967-45a2-4438-b854-7cfb2ec9459e req-b60f389b-dba2-4493-816c-1b7bc99cb35d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 947 time: 0.0893970
May 26 14:59:24.542629 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c96ec967-45a2-4438-b854-7cfb2ec9459e req-0e4b603e-4f0b-486a-b050-056ff26a9a9c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407085
May 26 14:59:24.551355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:24.564170 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:24.724105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Allocated IP 172.20.0.10 (5bdb145e-267b-43cd-9426-f92f373c5ed5/a5c1fbe6-787f-4fc0-9f39-1179f60b94a5/569fad69-3482-4ba8-829b-ffd9c0bc4482) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:24.767631 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device af4a6c11-6609-4623-bb2f-1fecb6f3099a details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:59:24.934249 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:24.944412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:24.949585 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a', 'network_id': 'acf7e4b9-87b3-4e48-b7f3-29816212960d', 'port_id': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a', 'mac_address': 'fa:16:3e:fc:db:8a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1249, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11ad92d2-48d9-4f94-96d6-0af955f646ce', 'ip_address': '192.168.233.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:59:24.998078 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de429c03-87b9-4c37-817b-b4984f0894cb req-7cc1809b-c27b-409a-8336-bc8b65e046fb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:24.999543 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-de429c03-87b9-4c37-817b-b4984f0894cb req-7cc1809b-c27b-409a-8336-bc8b65e046fb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0886974
May 26 14:59:25.006280 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.024726 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af4a6c11-6609-4623-bb2f-1fecb6f3099a {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:25.043617 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:25.049451 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-de429c03-87b9-4c37-817b-b4984f0894cb req-fbd2aefa-ad42-4c66-99d6-073d735b87dc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420444
May 26 14:59:25.054416 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.060139 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:25.075915 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:25.130775 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:25.133839 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:25.137937 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:25.161780 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.165651 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-4a98861e-2702-48a2-81bd-25c437f965ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:25.175716 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event updated for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:25.184458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:25.215151 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:25.216095 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.240105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:25.245778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:25.401814 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1171527
May 26 14:59:25.402267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 req-04ec95a2-a906-447d-b037-4a5c8c16aef6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:25.403742 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 req-04ec95a2-a906-447d-b037-4a5c8c16aef6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.1060052
May 26 14:59:25.427624 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Request body: {'port': {'device_id': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:25.455575 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 req-c9c3b0eb-01c7-4e3b-a8a1-c32c2a5bf457 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451255
May 26 14:59:25.497640 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['af4a6c11-6609-4623-bb2f-1fecb6f3099a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:25.555964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7506d7d9-6ed9-41d9-a597-a836b30dff8b req-4fa7fb1d-fe9a-4f66-b0fe-4fc0015657e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:25.556549 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-7506d7d9-6ed9-41d9-a597-a836b30dff8b req-4fa7fb1d-fe9a-4f66-b0fe-4fc0015657e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:25.582842 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.652431 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-7506d7d9-6ed9-41d9-a597-a836b30dff8b req-4fa7fb1d-fe9a-4f66-b0fe-4fc0015657e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:25.653631 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7506d7d9-6ed9-41d9-a597-a836b30dff8b req-4fa7fb1d-fe9a-4f66-b0fe-4fc0015657e3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 932 time: 0.2996504
May 26 14:59:25.678527 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:25.784864 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7506d7d9-6ed9-41d9-a597-a836b30dff8b req-0e4c3f32-73f0-4c37-98b9-95f59623bc5a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1214025
May 26 14:59:25.808138 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-664e2272-271b-43a7-a0fb-9455893fa069 req-c72a9a06-f88a-4a79-8c65-280a0b1fdca2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:25.809715 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-664e2272-271b-43a7-a0fb-9455893fa069 req-c72a9a06-f88a-4a79-8c65-280a0b1fdca2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 948 time: 0.1124249
May 26 14:59:25.858345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-664e2272-271b-43a7-a0fb-9455893fa069 req-2cc4b0d9-0d19-4617-aa05-a4ce62983e95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425656
May 26 14:59:26.081777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 569fad69-3482-4ba8-829b-ffd9c0bc4482 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:26.089338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:26.105784 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Transition to ACTIVE for port object 569fad69-3482-4ba8-829b-ffd9c0bc4482 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:26.246203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2ce38fe-95fb-4c80-827e-e23f03534b75 req-b4bb1782-bf7a-417d-bc32-af9135545df7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:26.248618 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a2ce38fe-95fb-4c80-827e-e23f03534b75 req-b4bb1782-bf7a-417d-bc32-af9135545df7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0842566
May 26 14:59:26.249796 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:26.253971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-71d2f31b-fc5f-4229-b519-01b9e8a620b1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:26.415142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Pushing event updated for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:26.445068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:26.462068 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a2ce38fe-95fb-4c80-827e-e23f03534b75 req-25a3dbe4-3986-4413-875b-5fef18f45bc6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1725838
May 26 14:59:26.542826 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Attempting to bind port 569fad69-3482-4ba8-829b-ffd9c0bc4482 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:26.543165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Attempting to bind port 569fad69-3482-4ba8-829b-ffd9c0bc4482 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:26.544975 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Attempting to bind port 569fad69-3482-4ba8-829b-ffd9c0bc4482 on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:26.551911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Port 569fad69-3482-4ba8-829b-ffd9c0bc4482 on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:59:26.552239 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Attempting to bind port 569fad69-3482-4ba8-829b-ffd9c0bc4482 on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:26.560501 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 58, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:26.560882 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Checking segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:26.561208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Bound using segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:26.561662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Bound port: 569fad69-3482-4ba8-829b-ffd9c0bc4482, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:26.562062 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:26.668537 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:26.672381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:26.769972 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 req-0b89958b-f591-49cf-af38-15fa990cb136 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:26.771491 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 req-0b89958b-f591-49cf-af38-15fa990cb136 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 944 time: 0.1893597
May 26 14:59:26.781878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:59:26.786364 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:26.791472 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-427a5c44-9775-4cf2-b0fa-e3a3308a4895 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:26.809181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device af4a6c11-6609-4623-bb2f-1fecb6f3099a up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:26.821002 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 req-4513df72-06bf-4db6-bc9b-3975ac408d10 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436170
May 26 14:59:26.857927 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:26.858546 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:26.860292 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] 10.222.0.32 "PUT /v2.0/ports/569fad69-3482-4ba8-829b-ffd9c0bc4482 HTTP/1.1" status: 200  len: 1094 time: 1.4435093
May 26 14:59:26.869620 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:26.958849 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482', 'status': 'completed', 'code': 200}
May 26 14:59:26.999008 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Pushing event updated for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:27.004279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:27.084261 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad req-3627997a-a0dc-4c26-bc7e-f035fa3e4283 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.085785 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad req-3627997a-a0dc-4c26-bc7e-f035fa3e4283 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 944 time: 0.1810477
May 26 14:59:27.088635 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-d4e4af2f-1726-42b7-a152-47d637004d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.090041 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-d4e4af2f-1726-42b7-a152-47d637004d15 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 1097 time: 0.1304078
May 26 14:59:27.092433 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:27.107768 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15', 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298', 'port_id': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15', 'mac_address': 'fa:16:3e:02:1d:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1220, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bdad3913-e712-409a-9b8b-ccdccd8ad915', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:59:27.137558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ed7be2-614a-475b-bec6-fb7f595075b7 req-4f58afca-b82e-4279-a830-b6964481eede tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.139785 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port af4a6c11-6609-4623-bb2f-1fecb6f3099a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:27.140300 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68ed7be2-614a-475b-bec6-fb7f595075b7 req-4f58afca-b82e-4279-a830-b6964481eede tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 948 time: 0.1009111
May 26 14:59:27.158275 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port af4a6c11-6609-4623-bb2f-1fecb6f3099a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:27.158653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.202775 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68ed7be2-614a-475b-bec6-fb7f595075b7 req-5a578000-cd30-4587-8aa1-e1b846fe3565 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0545449
May 26 14:59:27.216354 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad req-e868eb0b-bfc8-4519-a74c-294797658687 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1247754
May 26 14:59:27.231006 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.257152 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:27.265609 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-3131a416-5b94-4c70-84da-fddac18676b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.267102 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-3131a416-5b94-4c70-84da-fddac18676b8 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=1515325707f64d58a28f26451b2c74de&shared=False HTTP/1.1" status: 200  len: 917 time: 0.1600976
May 26 14:59:27.278424 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:27.335541 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.367653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:27.378740 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:27.379746 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.381631 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:27.425934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-d7276c90-30b9-4e48-838c-bc6e3517b0ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.426917 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a', 'code': 200}
May 26 14:59:27.427372 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-d7276c90-30b9-4e48-838c-bc6e3517b0ab service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1464610
May 26 14:59:27.453715 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:27.462791 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:27.475146 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.476996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-094e4065-7b7e-40f7-ad24-597f569510a5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:27.569855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-5f4ced53-04d3-4eda-ba3b-1774b4afb4f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.571637 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:27.571749 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-5f4ced53-04d3-4eda-ba3b-1774b4afb4f6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 1097 time: 0.0792966
May 26 14:59:27.574655 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:27.619938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:27.665804 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-633ef561-84a6-4948-adfe-9a1c2fc1e08c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482 HTTP/1.1" status: 200  len: 217 time: 0.0783610
May 26 14:59:27.722564 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:27.789762 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-9272fe2b-217c-46f2-8fed-145cf5415da5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.791167 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-9272fe2b-217c-46f2-8fed-145cf5415da5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 200  len: 855 time: 0.0890009
May 26 14:59:27.806615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a req-b89a3dba-9598-4802-b837-eff2c577b8e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.808242 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a req-b89a3dba-9598-4802-b837-eff2c577b8e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1448672
May 26 14:59:27.869421 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-2d062668-77c1-4b7d-9767-069fdcc0299a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=5bdb145e-267b-43cd-9426-f92f373c5ed5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0602448
May 26 14:59:27.879994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-493549d9-e281-4fe4-9057-c0d869f8c5d6 req-5a4f8802-8c1b-40fb-91cf-9e2a0f35bfe1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:27.884325 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-493549d9-e281-4fe4-9057-c0d869f8c5d6 req-5a4f8802-8c1b-40fb-91cf-9e2a0f35bfe1 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 1102 time: 0.0807731
May 26 14:59:27.938808 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-493549d9-e281-4fe4-9057-c0d869f8c5d6 req-35a997be-d7ae-4ad0-a42c-5ccba0f102a0 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0453048
May 26 14:59:28.045647 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-160bae89-7fcf-4860-a287-c62f818ccba5 req-0ac77229-61d8-4e5b-9c0b-e57062326b0d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:28.047324 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-160bae89-7fcf-4860-a287-c62f818ccba5 req-0ac77229-61d8-4e5b-9c0b-e57062326b0d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 945 time: 0.0897951
May 26 14:59:28.051156 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a req-5e7977a2-dc4c-4392-958a-789bd347253e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2109811
May 26 14:59:28.099194 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-021fb5c3-71af-44a8-aba7-a0282155d16f service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2206047
May 26 14:59:28.105144 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-160bae89-7fcf-4860-a287-c62f818ccba5 req-9ae53e11-ba30-441d-ad14-a2ea6975d2f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393918
May 26 14:59:28.235512 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-543b6b46-4e10-40f0-bc27-92467df9bba5 req-9da2ce27-28c5-4dee-939c-addec3196df2 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1285045
May 26 14:59:28.397064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af1bd8b7-3c45-449a-a920-457884fceb7a req-77a0d634-672f-4791-bde2-a3b9fb76e57d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:28.398593 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-af1bd8b7-3c45-449a-a920-457884fceb7a req-77a0d634-672f-4791-bde2-a3b9fb76e57d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0865641
May 26 14:59:28.402211 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cc6d211-65af-422f-af25-6128823d45b1 req-a94eefdf-83c0-4fd0-acb8-1097ecbb046e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:28.403724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8cc6d211-65af-422f-af25-6128823d45b1 req-a94eefdf-83c0-4fd0-acb8-1097ecbb046e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 944 time: 0.0799074
May 26 14:59:28.446121 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-af1bd8b7-3c45-449a-a920-457884fceb7a req-ede0292c-9191-4289-8ddf-4d8a174d9f78 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0407805
May 26 14:59:28.447792 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8cc6d211-65af-422f-af25-6128823d45b1 req-187842e9-a3e0-4efa-a316-2349a92114e7 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0382864
May 26 14:59:28.779776 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:28.934288 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:28.939650 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:28.940015 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:29.060059 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:29.110613 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:29.227075 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:29.230761 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:29.298007 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f req-342e3217-03bf-46e3-aa0d-610f6ecb6eda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:29.300173 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f req-342e3217-03bf-46e3-aa0d-610f6ecb6eda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1310112
May 26 14:59:29.338061 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:29.341669 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:29.360266 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f req-f58b8c58-60e3-4e70-b654-efa4ecb1bff8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0517640
May 26 14:59:29.428467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:29.536624 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6fcca92-e5b4-40d0-b572-5d824803e788 req-039210e2-113b-4c05-8e84-3882a4bb4550 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:29.538159 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a6fcca92-e5b4-40d0-b572-5d824803e788 req-039210e2-113b-4c05-8e84-3882a4bb4550 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.0835767
May 26 14:59:29.588569 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a6fcca92-e5b4-40d0-b572-5d824803e788 req-527e1af8-026c-4cb9-a805-0044156923c9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442259
May 26 14:59:29.640235 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15', 'code': 200}
May 26 14:59:29.815082 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c430260e-a8e4-4978-8f73-a816e301c9a0 req-ca9ffe73-3df8-4773-a858-6ae10a7a1b98 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:29.816607 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c430260e-a8e4-4978-8f73-a816e301c9a0 req-ca9ffe73-3df8-4773-a858-6ae10a7a1b98 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0878804
May 26 14:59:29.863665 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c430260e-a8e4-4978-8f73-a816e301c9a0 req-5ec62fe0-afa7-45b3-97a3-1dba9feaf8fc tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412037
May 26 14:59:30.052714 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca33c75d-8162-4d90-b3be-51ae83a372ca req-8a635d7d-8028-4e2e-a892-2d3387ff1679 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:30.054392 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ca33c75d-8162-4d90-b3be-51ae83a372ca req-8a635d7d-8028-4e2e-a892-2d3387ff1679 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 944 time: 0.0867784
May 26 14:59:30.102432 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ca33c75d-8162-4d90-b3be-51ae83a372ca req-0f4ab3c1-28ee-473c-9a00-87a0dd3011eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0402648
May 26 14:59:30.290799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29085667-6b76-4b50-adfb-2007aab1c186 req-5351d2f2-0289-4313-845c-3293a29849cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:30.292262 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-29085667-6b76-4b50-adfb-2007aab1c186 req-5351d2f2-0289-4313-845c-3293a29849cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0895488
May 26 14:59:30.336364 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-29085667-6b76-4b50-adfb-2007aab1c186 req-d1936f01-9e40-4be8-a895-91df7ba41281 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383122
May 26 14:59:30.554321 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 req-bd4e8728-36ad-44e2-872a-234c8fc9b1d9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:30.555899 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 req-bd4e8728-36ad-44e2-872a-234c8fc9b1d9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0866666
May 26 14:59:30.601296 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 req-7305eb14-1305-426a-b09d-e712402366ce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396848
May 26 14:59:30.632672 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 req-4ca235b5-547b-4c47-83be-eb51d74fffbe tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:30.634169 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 req-4ca235b5-547b-4c47-83be-eb51d74fffbe tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0801077
May 26 14:59:30.679648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 req-4ad366d3-6558-4f63-87f0-e09e1394244c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0398600
May 26 14:59:30.771298 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37094a5b-4af3-44dc-9b51-51246657cc21 req-17e44f2c-8d75-451a-8a74-74d93c96ce1c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:30.772738 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-37094a5b-4af3-44dc-9b51-51246657cc21 req-17e44f2c-8d75-451a-8a74-74d93c96ce1c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.0791948
May 26 14:59:30.816646 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-37094a5b-4af3-44dc-9b51-51246657cc21 req-d3bec02b-b543-40b2-8525-5f632a485eea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380235
May 26 14:59:31.291705 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73cbb60e-b367-4563-90a7-a41f18bee372 req-1be0269f-df53-4b91-9346-41f14663be26 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:31.293121 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73cbb60e-b367-4563-90a7-a41f18bee372 req-1be0269f-df53-4b91-9346-41f14663be26 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 944 time: 0.0817757
May 26 14:59:31.336700 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73cbb60e-b367-4563-90a7-a41f18bee372 req-6d6b4fcd-11f1-4e79-97f9-ff11000cce16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0374424
May 26 14:59:31.528444 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb req-5f40819e-5441-4eef-a96d-c9032d283cf1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:31.529833 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb req-5f40819e-5441-4eef-a96d-c9032d283cf1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0824308
May 26 14:59:31.574669 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb req-c0e69c72-b526-494b-a8d6-7c883670f308 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387383
May 26 14:59:31.787125 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540effe0-be0c-47f1-8a40-12bd67bb359e req-6af721fc-8ca1-4607-a250-572fab0c1c43 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:31.788798 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-540effe0-be0c-47f1-8a40-12bd67bb359e req-6af721fc-8ca1-4607-a250-572fab0c1c43 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0822518
May 26 14:59:31.838502 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-540effe0-be0c-47f1-8a40-12bd67bb359e req-77f9b26e-5c69-418d-80f6-979b64c1bb28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441124
May 26 14:59:31.871070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f23f213-2f8a-4887-8775-8c7fe975c601 req-f3ff0535-11d4-4b9c-8386-152d385af91d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:31.872533 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7f23f213-2f8a-4887-8775-8c7fe975c601 req-f3ff0535-11d4-4b9c-8386-152d385af91d tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0830386
May 26 14:59:31.923479 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7f23f213-2f8a-4887-8775-8c7fe975c601 req-413824de-cf40-4d11-85d5-4251d528c738 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0446470
May 26 14:59:32.009517 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-257a095d-648d-4fae-9eab-f4f66346dbf7 req-20ee6c34-e823-4e8c-9423-740fe5ce81fd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:32.010969 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-257a095d-648d-4fae-9eab-f4f66346dbf7 req-20ee6c34-e823-4e8c-9423-740fe5ce81fd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.0799069
May 26 14:59:32.056302 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-257a095d-648d-4fae-9eab-f4f66346dbf7 req-ca326e5e-a998-4a90-afa0-deaf1363a6e5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0397601
May 26 14:59:32.518811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f36cd2a-9620-4f72-8396-3a59605197fd req-bb492cb6-e9cb-4247-bce5-44cdb3ce120b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:32.520449 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7f36cd2a-9620-4f72-8396-3a59605197fd req-bb492cb6-e9cb-4247-bce5-44cdb3ce120b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 944 time: 0.0803244
May 26 14:59:32.565427 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7f36cd2a-9620-4f72-8396-3a59605197fd req-7dba48d1-d732-49b4-8eb5-02ffea937d9e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392470
May 26 14:59:32.766357 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 req-f60031b7-16b4-4b3e-9f6a-2e92e1dc66af tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:32.768426 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 req-f60031b7-16b4-4b3e-9f6a-2e92e1dc66af tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0834396
May 26 14:59:32.816157 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 req-55f39069-905d-4434-a01a-05d0ac9e8fff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417855
May 26 14:59:32.825364 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 569fad69-3482-4ba8-829b-ffd9c0bc4482 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:59:32.916412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31bcf3f0-b133-49de-87da-3ae6a20863c1 req-56785423-96c6-4a16-9bc5-46e766841e40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:32.919525 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-31bcf3f0-b133-49de-87da-3ae6a20863c1 req-56785423-96c6-4a16-9bc5-46e766841e40 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 1099 time: 0.1022935
May 26 14:59:32.984251 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-31bcf3f0-b133-49de-87da-3ae6a20863c1 req-26b60508-74d1-48ef-9ec8-68e6220aed00 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391834
May 26 14:59:33.021418 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:33.037817 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '569fad69-3482-4ba8-829b-ffd9c0bc4482', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'port_id': '569fad69-3482-4ba8-829b-ffd9c0bc4482', 'mac_address': 'fa:16:3e:80:a1:7a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a5c1fbe6-787f-4fc0-9f39-1179f60b94a5', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:59:33.072645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06369781-2a48-4a7d-b50b-306cb589f642 req-481cf293-83ea-4adf-90da-8645b1bc0e60 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:33.074319 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-06369781-2a48-4a7d-b50b-306cb589f642 req-481cf293-83ea-4adf-90da-8645b1bc0e60 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1157618
May 26 14:59:33.114171 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:33.148744 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 569fad69-3482-4ba8-829b-ffd9c0bc4482 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:33.150539 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-06369781-2a48-4a7d-b50b-306cb589f642 req-5fa6b27e-01e7-485f-8c0c-2a0bba40d585 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689945
May 26 14:59:33.181117 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:33.221324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfbcbc48-8d7a-4d56-8102-d94ad8b66f9f req-4b0aa918-a5f2-4021-8c2b-dfcf3d5025d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:33.223112 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cfbcbc48-8d7a-4d56-8102-d94ad8b66f9f req-4b0aa918-a5f2-4021-8c2b-dfcf3d5025d9 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.1128359
May 26 14:59:33.231779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 req-3cd9d12c-1d58-42da-b1e1-a018953dc448 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:33.232947 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 req-3cd9d12c-1d58-42da-b1e1-a018953dc448 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.1662199
May 26 14:59:33.307998 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cfbcbc48-8d7a-4d56-8102-d94ad8b66f9f req-d711d51d-c17a-4349-a817-80bbd35afc47 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0740812
May 26 14:59:33.319608 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 req-de4dde04-b2aa-4117-aaf6-dc8353016508 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0645394
May 26 14:59:33.345616 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:33.347466 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:33.366806 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b req-3e1c4cbe-742d-4eec-8c27-ca8a19988995 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:33.368460 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b req-3e1c4cbe-742d-4eec-8c27-ca8a19988995 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.1123416
May 26 14:59:33.425766 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b req-df6b19a2-e0a0-4cef-b719-4eb2d44dca2a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0511169
May 26 14:59:33.426383 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:33.429587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:33.768559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 req-6cedef65-ce21-4ca3-8c28-6533c96508cf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:33.769970 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 req-6cedef65-ce21-4ca3-8c28-6533c96508cf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 945 time: 0.0848708
May 26 14:59:33.816713 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 req-0c1ea629-0781-478e-bb4b-1d10ea2e590a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0411460
May 26 14:59:34.052763 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['569fad69-3482-4ba8-829b-ffd9c0bc4482'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:34.167426 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 req-cb0994e7-cced-4c24-8c8d-bbe2a3400b61 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:34.169244 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 req-cb0994e7-cced-4c24-8c8d-bbe2a3400b61 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0894907
May 26 14:59:34.222511 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 req-6544cb4c-17e2-414e-b217-8b02978b9ed0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0460134
May 26 14:59:34.396174 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f91435a-5b5d-42b3-80f1-10cdeef77854 req-1a7065d6-2937-4fba-8d37-12cb0840c05f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:34.398410 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0f91435a-5b5d-42b3-80f1-10cdeef77854 req-1a7065d6-2937-4fba-8d37-12cb0840c05f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1277544
May 26 14:59:34.448064 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0f91435a-5b5d-42b3-80f1-10cdeef77854 req-b94f0aea-7b8c-40c3-95c1-cfbfc2c31429 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0439687
May 26 14:59:34.535222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fa8d9fd-2518-4b4b-a10f-7175fca469be req-561ce2cb-62c8-40a1-9c55-573bfd89900b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:34.536750 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3fa8d9fd-2518-4b4b-a10f-7175fca469be req-561ce2cb-62c8-40a1-9c55-573bfd89900b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0879951
May 26 14:59:34.623714 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3fa8d9fd-2518-4b4b-a10f-7175fca469be req-20e32414-29d8-4386-87e4-92a98ebde5b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0477066
May 26 14:59:34.640876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45ceaa6f-996a-462a-84b3-226f07bcee71 req-a86840ad-6c5c-4181-b8a9-f3d6c76c9c3c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:34.642976 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-45ceaa6f-996a-462a-84b3-226f07bcee71 req-a86840ad-6c5c-4181-b8a9-f3d6c76c9c3c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.0956988
May 26 14:59:34.695600 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-45ceaa6f-996a-462a-84b3-226f07bcee71 req-e7cfd200-61e0-4d65-aaec-3496add7d8be tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0466280
May 26 14:59:35.093162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1992c7cb-3c47-489a-aea6-aefd0a669e55 req-74208e61-634a-4c19-b5e4-4dfb9cae759b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:35.094678 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1992c7cb-3c47-489a-aea6-aefd0a669e55 req-74208e61-634a-4c19-b5e4-4dfb9cae759b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 945 time: 0.1700826
May 26 14:59:35.141345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1992c7cb-3c47-489a-aea6-aefd0a669e55 req-d4a6e972-45c9-444a-aa34-e896cb9f456f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408547
May 26 14:59:35.431073 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a req-ec80609e-6ed6-4872-88df-5f02130f6443 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:35.432676 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a req-ec80609e-6ed6-4872-88df-5f02130f6443 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0822229
May 26 14:59:35.483335 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a req-fc2500a4-2133-4ee4-896c-32d1829d08ac tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0448184
May 26 14:59:35.637954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866b03ab-f292-4911-b22a-779826bcf586 req-88818e43-b4c2-49e6-b346-2eead1e1e01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:35.639526 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-866b03ab-f292-4911-b22a-779826bcf586 req-88818e43-b4c2-49e6-b346-2eead1e1e01a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0829852
May 26 14:59:35.686696 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-866b03ab-f292-4911-b22a-779826bcf586 req-f67918c7-13f9-4fb4-b7e5-8e1147c8b85b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412455
May 26 14:59:35.859617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 req-f4f8a663-69ff-46e3-a22e-cf7f2640707b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:35.861050 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 req-f4f8a663-69ff-46e3-a22e-cf7f2640707b tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.0814815
May 26 14:59:35.915937 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 req-ffdb55c9-647a-4745-a183-33578dd01784 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0451419
May 26 14:59:36.090791 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-f81ba155-8ba1-4a9f-aaf8-b34f0307dde4 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.092116 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-f81ba155-8ba1-4a9f-aaf8-b34f0307dde4 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.32 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 949 time: 0.1447909
May 26 14:59:36.100778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6363971-b8e3-46a4-aacb-82b1584f202f req-d51af650-cf76-4764-938f-23990b8222d6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.102154 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f6363971-b8e3-46a4-aacb-82b1584f202f req-d51af650-cf76-4764-938f-23990b8222d6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.1234825
May 26 14:59:36.102786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c req-8f646912-aafa-4682-932e-644ce41cd89e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.104257 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c req-8f646912-aafa-4682-932e-644ce41cd89e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0815296
May 26 14:59:36.150001 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c req-b7721916-0287-4987-bcac-cfca68b8a685 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397124
May 26 14:59:36.288236 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f6363971-b8e3-46a4-aacb-82b1584f202f req-5caa171a-4a3f-4983-98e1-b8a3cd1f989a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1570647
May 26 14:59:36.327343 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Deleting port af4a6c11-6609-4623-bb2f-1fecb6f3099a {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 14:59:36.327904 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:36.558376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] For port af4a6c11-6609-4623-bb2f-1fecb6f3099a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=af4a6c11-6609-4623-bb2f-1fecb6f3099a,segment=NetworkSegment(1f795401-233e-4b1b-a86a-8738ee2a8006),segment_id=1f795401-233e-4b1b-a86a-8738ee2a8006)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:36.559029 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:36.577736 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad27f96c-5a8b-4725-8221-88732941ec45 req-987b2e3e-e35f-4735-9774-d44a5264d186 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.585235 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad27f96c-5a8b-4725-8221-88732941ec45 req-987b2e3e-e35f-4735-9774-d44a5264d186 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 945 time: 0.1777706
May 26 14:59:36.691772 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-b6640728-2d6d-4a70-af62-465cfa0d86dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.693241 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-b6640728-2d6d-4a70-af62-465cfa0d86dd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.1510522
May 26 14:59:36.703256 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 req-500c7320-95ad-490a-a131-819c8ca83703 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.704644 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 req-500c7320-95ad-490a-a131-819c8ca83703 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1212132
May 26 14:59:36.741412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling delete_port for af4a6c11-6609-4623-bb2f-1fecb6f3099a owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 14:59:36.771294 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad27f96c-5a8b-4725-8221-88732941ec45 req-eedbd72c-096b-4dbf-aa48-11f49602cda6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1851645
May 26 14:59:36.816654 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 569fad69-3482-4ba8-829b-ffd9c0bc4482 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:36.839167 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 req-48331aa3-0501-4592-8583-0c57b613b84f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1285841
May 26 14:59:36.900334 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-608a4a39-d005-4a45-bc54-dcfffd83dcc0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.902388 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-608a4a39-d005-4a45-bc54-dcfffd83dcc0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1907611
May 26 14:59:36.979799 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-948bda48-bbe6-4e03-aecc-61cb95275f07 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.0686724
May 26 14:59:36.983870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998fa53d-526d-43fe-89d9-f75daea17e39 req-f2a75e69-725c-4e95-994c-5a9b16ff30d5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:36.985142 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 569fad69-3482-4ba8-829b-ffd9c0bc4482 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:36.988692 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-998fa53d-526d-43fe-89d9-f75daea17e39 req-f2a75e69-725c-4e95-994c-5a9b16ff30d5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0966284
May 26 14:59:36.991331 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 569fad69-3482-4ba8-829b-ffd9c0bc4482 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:36.991996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:37.044648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-998fa53d-526d-43fe-89d9-f75daea17e39 req-05a06a15-0205-46c7-a13a-b9c8aa478000 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515766
May 26 14:59:37.104801 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:37.116103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:37.121962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['af4a6c11-6609-4623-bb2f-1fecb6f3099a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:37.128828 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-884ab570-6ddc-4706-9c1a-ed9d922d5e3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:37.130468 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-884ab570-6ddc-4706-9c1a-ed9d922d5e3a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.1430097
May 26 14:59:37.168786 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Pushing event deleted for resources: {'Port': ['ID=af4a6c11-6609-4623-bb2f-1fecb6f3099a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:37.170066 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:37.208350 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:37.264694 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bfe093f-462d-47c8-9669-7a006441321f req-1f38cfab-2477-40b8-93e3-964fdd2e9380 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:37.264910 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:37.265021 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4bfe093f-462d-47c8-9669-7a006441321f req-1f38cfab-2477-40b8-93e3-964fdd2e9380 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 867 time: 0.1763990
May 26 14:59:37.265021 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-52a9e26a-2967-4d16-a256-f1feda03db26 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1079586
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.265962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.266485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.267111 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.267607 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:37.282275 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:37.282872 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4bfe093f-462d-47c8-9669-7a006441321f req-7b634994-9cb5-435a-9629-8b2e83a64121 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/security-groups?id=abb7dcdf-8b15-4853-85c1-449e65d9fcea&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524523
May 26 14:59:37.329945 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] No DVR routers for this DVR port af4a6c11-6609-4623-bb2f-1fecb6f3099a on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 14:59:37.337776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:37.341350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'name': 'network-vif-deleted', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:37.351342 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:37.355782 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:37.451156 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9357694b-0ef8-4988-9fd0-f795855f9a99', 'name': 'network-vif-deleted', 'tag': 'af4a6c11-6609-4623-bb2f-1fecb6f3099a', 'status': 'completed', 'code': 200}
May 26 14:59:37.459436 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482', 'code': 200}
May 26 14:59:37.504501 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.32 "DELETE /v2.0/ports/af4a6c11-6609-4623-bb2f-1fecb6f3099a HTTP/1.1" status: 204  len: 173 time: 1.4013374
May 26 14:59:37.523922 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:37.525419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 req-b0b45709-e299-4b86-8342-87ce6949428e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:37.528373 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 req-b0b45709-e299-4b86-8342-87ce6949428e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1289215
May 26 14:59:37.544857 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:37.544962 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-d26b71cd-7dce-471c-9295-1f53feb95f4d service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2560337
May 26 14:59:37.579612 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 req-a2fa5a6b-86bd-4551-b0ea-4321fb6ee720 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426488
May 26 14:59:37.682136 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 req-9e00165a-8a58-45c6-aea6-71b9c9cbbe0c service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1394086
May 26 14:59:37.871472 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f9adea-7d58-4584-a935-a302f73b227e req-53273f10-0f1a-4137-a864-70dbe7d124b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:37.873238 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a0f9adea-7d58-4584-a935-a302f73b227e req-53273f10-0f1a-4137-a864-70dbe7d124b9 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 1099 time: 0.0784826
May 26 14:59:37.959626 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a0f9adea-7d58-4584-a935-a302f73b227e req-8f4a562b-aefc-43b0-b185-2883bf2aa3ae service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794833
May 26 14:59:37.999428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b18ca07-460c-4d98-b1bb-eeef063285ce req-3d5ac397-6081-42f4-b951-f6034d88349e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:38.000933 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3b18ca07-460c-4d98-b1bb-eeef063285ce req-3d5ac397-6081-42f4-b951-f6034d88349e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.0984542
May 26 14:59:38.026128 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ab4a87-2403-4a32-8f25-84faea86430e req-f14b654d-ad94-4852-9723-21837f05624c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:38.028064 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d2ab4a87-2403-4a32-8f25-84faea86430e req-f14b654d-ad94-4852-9723-21837f05624c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0840344
May 26 14:59:38.054717 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3b18ca07-460c-4d98-b1bb-eeef063285ce req-c0c11542-78b3-4974-b3ed-adb1c5ef41e9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0472639
May 26 14:59:38.084375 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d2ab4a87-2403-4a32-8f25-84faea86430e req-a38525cf-1b0f-482c-bde4-17037f94bab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481627
May 26 14:59:38.239989 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71751a3d-0c60-4f79-93fd-d842ac056b0b req-6fa61592-ab2b-40f9-841c-5d151f7fd7fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:38.241507 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-71751a3d-0c60-4f79-93fd-d842ac056b0b req-6fa61592-ab2b-40f9-841c-5d151f7fd7fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0835965
May 26 14:59:38.287468 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-71751a3d-0c60-4f79-93fd-d842ac056b0b req-fe487047-e360-44a6-ad3a-cc4429064bc7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402675
May 26 14:59:38.463773 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 req-ba3eea2f-6660-46a3-a4c8-4d6525940967 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Synchronizing usage tracker for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:38.585123 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 req-ba3eea2f-6660-46a3-a4c8-4d6525940967 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Unset dirty status for tenant:5a4d985046c34c1eb9e28915d7ebb5b5 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:38.586334 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 req-ba3eea2f-6660-46a3-a4c8-4d6525940967 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /v2.0/ports?device_id=9357694b-0ef8-4988-9fd0-f795855f9a99 HTTP/1.1" status: 200  len: 210 time: 0.1689413
May 26 14:59:38.775570 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-187c624e-7e27-420d-a8bd-57ae774a9b82 req-76fdd424-20f2-4075-b348-f1735e21c712 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:38.777285 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-187c624e-7e27-420d-a8bd-57ae774a9b82 req-76fdd424-20f2-4075-b348-f1735e21c712 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0837951
May 26 14:59:38.826312 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-187c624e-7e27-420d-a8bd-57ae774a9b82 req-bcca1429-1735-4f3e-a7d5-b7e12d66acca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433505
May 26 14:59:39.245508 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f req-fa6077d6-f3de-4ded-92fc-a2f4f0679be7 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:39.246978 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f req-fa6077d6-f3de-4ded-92fc-a2f4f0679be7 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.0801704
May 26 14:59:39.270358 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 req-9cc297a5-55b2-4ef2-836e-a9b9b2d43d1a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:39.271977 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 req-9cc297a5-55b2-4ef2-836e-a9b9b2d43d1a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0810182
May 26 14:59:39.294893 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f req-89a02abc-c0ff-4f13-91b4-494466a9ea1c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0408480
May 26 14:59:39.334067 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 req-20e39e51-d397-441b-9440-ec552afd3add tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553837
May 26 14:59:39.487457 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c5a3524-3738-4eb9-95c8-ac2066aed71d req-b54aa780-bc0b-4a91-8dca-a16d29a8da7f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:39.488908 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c5a3524-3738-4eb9-95c8-ac2066aed71d req-b54aa780-bc0b-4a91-8dca-a16d29a8da7f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0835061
May 26 14:59:39.535700 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c5a3524-3738-4eb9-95c8-ac2066aed71d req-91a8f203-d8ae-411c-9b86-d2a986ca5791 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0411029
May 26 14:59:40.107367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 req-540285e4-8cd6-41ee-86f0-da745e6a5ec0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:40.108835 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 req-540285e4-8cd6-41ee-86f0-da745e6a5ec0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1662455
May 26 14:59:40.159887 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 req-66ec158e-7fd2-489b-9d4e-7226fff8af7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445673
May 26 14:59:40.546166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da2e0222-0d50-4f5a-bda0-d9e1446e361e req-e142c48a-19f2-430f-a563-c67a39f96797 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:40.547549 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da2e0222-0d50-4f5a-bda0-d9e1446e361e req-e142c48a-19f2-430f-a563-c67a39f96797 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0907180
May 26 14:59:40.574801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1138fe9-ea70-449a-87b2-427f86c6087e req-db4764ab-7f20-4075-a4c6-06f5f4de2282 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:40.576894 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f1138fe9-ea70-449a-87b2-427f86c6087e req-db4764ab-7f20-4075-a4c6-06f5f4de2282 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.1713707
May 26 14:59:40.593705 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da2e0222-0d50-4f5a-bda0-d9e1446e361e req-9c5b653e-45e4-4df7-a31d-9126158302b4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391850
May 26 14:59:40.631610 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f1138fe9-ea70-449a-87b2-427f86c6087e req-07b204e4-5cde-4e29-8ff8-c331d9631a0b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0489280
May 26 14:59:40.815537 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device af4a6c11-6609-4623-bb2f-1fecb6f3099a no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 14:59:40.854860 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: af4a6c11-6609-4623-bb2f-1fecb6f3099a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 14:59:40.855424 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device af4a6c11-6609-4623-bb2f-1fecb6f3099a not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 14:59:40.948389 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9446249b-0249-4dcf-85af-58c2e67caa78 req-441bce9f-475e-463d-97aa-fab081d7cc84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:40.957066 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9446249b-0249-4dcf-85af-58c2e67caa78 req-441bce9f-475e-463d-97aa-fab081d7cc84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1208992
May 26 14:59:41.023140 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9446249b-0249-4dcf-85af-58c2e67caa78 req-30864169-7b0a-44b2-8c0f-21972d9d9986 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0544577
May 26 14:59:41.367943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d184a2a-b246-4695-b2db-7545ee8878aa req-e882655e-775c-4853-baa6-8ffd061138cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:41.375779 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7d184a2a-b246-4695-b2db-7545ee8878aa req-e882655e-775c-4853-baa6-8ffd061138cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0961461
May 26 14:59:41.430542 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7d184a2a-b246-4695-b2db-7545ee8878aa req-53fdee30-f43c-4f3d-aa5e-b9e79686a99d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535033
May 26 14:59:41.879468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5072472-87dd-4074-90c1-65e18b45c3bb req-c4cb9f5e-60d8-4119-8dae-3db61a0c9434 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:41.879468 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c5072472-87dd-4074-90c1-65e18b45c3bb req-c4cb9f5e-60d8-4119-8dae-3db61a0c9434 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1732779
May 26 14:59:41.935629 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c5072472-87dd-4074-90c1-65e18b45c3bb req-1439b6d4-b138-42d0-b924-a08a55aa5302 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519915
May 26 14:59:41.952325 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 57820) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:42.135528 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.152620 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:42.188492 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Usage tracker for resource:security_group_rule and tenant:88f0c0675ca74e009ee61a1c8dec7898 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:42.199367 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:42.210416 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:42.280366 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 req-cfdb8991-8eb5-47f4-8193-4fc6a9ea24cb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:42.281898 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 req-cfdb8991-8eb5-47f4-8193-4fc6a9ea24cb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1268311
May 26 14:59:42.358385 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 req-d4087167-69d3-4c86-a03f-7581ef4a83b3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0691502
May 26 14:59:42.363425 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.426038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.433788 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:42.477614 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=88f0c0675ca74e009ee61a1c8dec7898&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5241063
May 26 14:59:42.479033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07008bae-0a8f-4a38-91f7-cd52cf0ad841,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:42.480484 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 57852) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:42.489096 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.489673 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.492714 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.493201 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.493714 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.494220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:42.498385 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:42.566457 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.642288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.716874 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea867441-bcd4-4458-8686-bb140261e247 req-62cc5489-da80-49fd-b1b6-026f40a4398d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:42.718588 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ea867441-bcd4-4458-8686-bb140261e247 req-62cc5489-da80-49fd-b1b6-026f40a4398d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1377044
May 26 14:59:42.777257 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ea867441-bcd4-4458-8686-bb140261e247 req-1a9e59b9-b693-448c-b9b9-a42a9e94cfb3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513535
May 26 14:59:42.808166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.813473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3eeba3c0-261e-4c60-a297-636250071fa0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:42.834299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07008bae-0a8f-4a38-91f7-cd52cf0ad841,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:42.838885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:42.845646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:42.849718 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/07008bae-0a8f-4a38-91f7-cd52cf0ad841 HTTP/1.1" status: 204  len: 168 time: 0.3683259
May 26 14:59:43.558315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe4388be-7f0d-424a-b158-4b8830cc4929 req-70de26e0-2851-41e2-a70d-2741d72c297f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:43.559800 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fe4388be-7f0d-424a-b158-4b8830cc4929 req-70de26e0-2851-41e2-a70d-2741d72c297f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0903838
May 26 14:59:43.617368 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fe4388be-7f0d-424a-b158-4b8830cc4929 req-19a27bba-14c3-4a8b-a85a-2542f52de0fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0510924
May 26 14:59:43.984852 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 57970) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:44.041577 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b5221e-21ec-49d8-bd8f-da0d22511059 req-8e5fd3ee-bd8d-4d4b-97ca-db98fd9d49a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:44.053595 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41af7ffc-cf13-4e68-9a42-a53319ec865a req-cdebaf4c-6f74-4ff1-aa3a-33f580b45b53 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:44.059322 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9b5221e-21ec-49d8-bd8f-da0d22511059 req-8e5fd3ee-bd8d-4d4b-97ca-db98fd9d49a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1639488
May 26 14:59:44.063803 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-41af7ffc-cf13-4e68-9a42-a53319ec865a req-cdebaf4c-6f74-4ff1-aa3a-33f580b45b53 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1389415
May 26 14:59:44.123320 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9b5221e-21ec-49d8-bd8f-da0d22511059 req-3656047b-4e34-477b-95ba-74d6960825bc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0567288
May 26 14:59:44.137316 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-41af7ffc-cf13-4e68-9a42-a53319ec865a req-24ca0397-9c83-44af-8016-41b9ebb08e9c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0718834
May 26 14:59:44.172501 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1504035339-network', 'tenant_id': 'dffd269c3a344d36b77ebb04d0c412e3'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:44.177661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:44.187278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Usage tracker for resource:network and tenant:dffd269c3a344d36b77ebb04d0c412e3 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:44.187278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:44.193185 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:44.277625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Made reservation on behalf of dffd269c3a344d36b77ebb04d0c412e3 for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:44.281442 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.296649 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.323335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:44.327552 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Usage tracker for resource:security_group_rule and tenant:dffd269c3a344d36b77ebb04d0c412e3 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:44.331397 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:44.338447 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:44.437938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.476177 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-aae54c68-71a3-4d82-bbf1-88bdecfea898 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:44.477635 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-aae54c68-71a3-4d82-bbf1-88bdecfea898 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.1696274
May 26 14:59:44.493205 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-200dc1f3-cb84-4acc-b204-f91bfca17526 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/quotas/1515325707f64d58a28f26451b2c74de HTTP/1.1" status: 200  len: 375 time: 0.0098214
May 26 14:59:44.556112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.560933 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2286922f-9706-40ba-853a-c28a7e3a6c7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:44.593664 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-569c0de6-0d20-41dd-b348-2e23f73e8372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0923028
May 26 14:59:44.594113 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1239}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:59:44.600128 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0fe11b4a-86c5-48f8-bf9f-1699f6b08150,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:44.603658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:44.606872 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.608117 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Added segment 68a5ec6b-7a18-4714-970b-4f682bf72674 of type vlan for network 85b44080-2458-40a2-bbbd-894b0448370a
May 26 14:59:44.648911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.727993 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.729389 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:44.729995 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:44.735779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bbc36034-58ce-4e36-a1b8-770b58247cf2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:44.774675 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-7d429599-610b-4bd1-95a3-388004eb61f5 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1755941
May 26 14:59:44.853918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Pushing event updated for resources: {'Network': ['ID=85b44080-2458-40a2-bbbd-894b0448370a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:44.870598 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 85b44080-2458-40a2-bbbd-894b0448370a details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:59:44.876338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:44.924699 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-bf3414a7-5a4c-4fa9-a8ac-e4c1875e8cd7 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1424956
May 26 14:59:44.960896 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 0.9724026
May 26 14:59:44.961892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58024) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:44.973378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Request body: {'subnet': {'network_id': '85b44080-2458-40a2-bbbd-894b0448370a', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1504035339-subnet', 'tenant_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:44.980805 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:44.989785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Usage tracker for resource:subnet and tenant:dffd269c3a344d36b77ebb04d0c412e3 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:44.996564 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:45.004700 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:45.070716 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Made reservation on behalf of dffd269c3a344d36b77ebb04d0c412e3 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:45.073253 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:45.336047 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-27c33c46-23db-4205-844e-bc5f71059602 req-74e8146f-a013-49e7-a0a6-68de1bae741d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 210 time: 0.0779314
May 26 14:59:45.379690 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 req-35645306-e696-4d23-84b7-2e1facb36e4a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:45.400425 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 req-35645306-e696-4d23-84b7-2e1facb36e4a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1193750
May 26 14:59:45.486233 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 req-c6c857c7-6e8e-4417-b7a6-609595d54a84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0891783
May 26 14:59:45.704629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 req-ac99434c-8350-4b40-a62a-0b06b136db32 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:45.706921 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 req-ac99434c-8350-4b40-a62a-0b06b136db32 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1854925
May 26 14:59:45.768913 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 req-afde13d9-d1c5-4cc2-9a06-a464b721a824 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0555706
May 26 14:59:45.828664 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:45.833846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db935e97-44c1-4a5b-be55-86b2ae66a492 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:45.906025 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Pushing event updated for resources: {'Subnet': ['ID=1ffbc503-b2cb-4a9f-8705-0778bedb7314,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:45.909430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:45.914943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Checking segment: {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:45.915285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Network hostable DHCP agents. Network: 85b44080-2458-40a2-bbbd-894b0448370a, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:59:46.059404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Network 85b44080-2458-40a2-bbbd-894b0448370a is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:59:46.150894 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 85b44080-2458-40a2-bbbd-894b0448370a) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:46.161672 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:46.161984 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7732dae9-27fe-4a92-96a8-6e16233ff8fc None None] Network 85b44080-2458-40a2-bbbd-894b0448370a requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:46.162468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:46.257769 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1bc6e636-968b-4f86-b7cc-fdae6a82017a admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 1.2840176
May 26 14:59:46.359383 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4dd2160-70f2-46af-b3c3-334a5ecdb488 None None] Network 85b44080-2458-40a2-bbbd-894b0448370a requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:46.552625 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ce3ba8-895d-4b7f-b7b5-609efcb366da req-7037e55a-426f-4a72-a8ec-59858eae17ed tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 210 time: 0.0825229
May 26 14:59:46.726595 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dffc5339-6c96-447f-97b1-1888024ec5fd req-87fb42f3-7998-4519-8750-c423e6322ca4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:46.728104 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dffc5339-6c96-447f-97b1-1888024ec5fd req-87fb42f3-7998-4519-8750-c423e6322ca4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0876117
May 26 14:59:46.775295 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dffc5339-6c96-447f-97b1-1888024ec5fd req-a7245ae4-d802-40fe-9a26-1ee04262b22d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414131
May 26 14:59:46.963437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a17d1074-893e-4982-88d2-697f6120ce39 req-26766fd0-12c1-4936-8c5f-e438c837a11d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:46.964965 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a17d1074-893e-4982-88d2-697f6120ce39 req-26766fd0-12c1-4936-8c5f-e438c837a11d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0859535
May 26 14:59:47.014368 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a17d1074-893e-4982-88d2-697f6120ce39 req-a5cc5f3e-4cea-4de9-896e-a6f3b5d6f744 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0420182
May 26 14:59:47.202022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58076) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:47.362353 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f3204a15-2f4e-407b-8d1d-da0e36126035 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5a4d985046c34c1eb9e28915d7ebb5b5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1583495
May 26 14:59:47.364661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58082) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:47.422547 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:47.452632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:47.619247 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:47.624138 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2638f538-8274-40d0-ac13-db95c64d26bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:47.655087 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abb7dcdf-8b15-4853-85c1-449e65d9fcea,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:47.658424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:47.717386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 req-91c641c1-8641-4666-b0fc-eb2c19495ab5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 210 time: 0.0453322
May 26 14:59:47.748648 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:47.750828 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/abb7dcdf-8b15-4853-85c1-449e65d9fcea HTTP/1.1" status: 204  len: 168 time: 0.3852806
May 26 14:59:47.761650 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-c9065559-db45-49eb-8d3d-04b743092aec tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:47.763091 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-c9065559-db45-49eb-8d3d-04b743092aec tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.2044132
May 26 14:59:47.778686 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Request body: {'port': {'device_id': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'admin_state_up': True, 'tenant_id': '1515325707f64d58a28f26451b2c74de'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:47.966451 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:47.980897 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:48.007791 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45394393-3603-4620-9ccc-1ddf4b82187a req-40b12a83-3272-40aa-9745-2c3fe61b604b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:48.009225 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-45394393-3603-4620-9ccc-1ddf4b82187a req-40b12a83-3272-40aa-9745-2c3fe61b604b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1102130
May 26 14:59:48.054808 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-45394393-3603-4620-9ccc-1ddf4b82187a req-a97c303a-194b-4081-bd5f-2d4029f03f38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397036
May 26 14:59:48.081809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:48.087804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:48.255211 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a160fff-d476-422a-aff5-e49057688997 req-981da51b-3e4a-438b-82f9-e95bf20c8b5d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:48.257001 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3a160fff-d476-422a-aff5-e49057688997 req-981da51b-3e4a-438b-82f9-e95bf20c8b5d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1120884
May 26 14:59:48.308603 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3a160fff-d476-422a-aff5-e49057688997 req-3326839b-7d3b-49b9-b50f-71cedfea9375 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456383
May 26 14:59:48.359036 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Allocated IP 172.20.0.12 (5bdb145e-267b-43cd-9426-f92f373c5ed5/a5c1fbe6-787f-4fc0-9f39-1179f60b94a5/3ab2e391-3d42-467d-8e80-fe132717746c) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:48.572140 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:48.665583 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:48.671912 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:48.677783 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df', '569fad69-3482-4ba8-829b-ffd9c0bc4482'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:48.761288 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:48.767083 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:48.773921 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:48.832309 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event updated for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:48.839351 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:48.902573 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:48.903196 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:48.982870 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58144) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:49.062076 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bf5b53a-2c11-406f-b4a9-716a4439e836 req-e50cf0fd-4fa9-4590-8044-c49d1141771f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:49.062839 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-6bf5b53a-2c11-406f-b4a9-716a4439e836 req-e50cf0fd-4fa9-4590-8044-c49d1141771f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:49.101992 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3277164
May 26 14:59:49.115324 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Request body: {'port': {'device_id': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:49.155038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-6bf5b53a-2c11-406f-b4a9-716a4439e836 req-e50cf0fd-4fa9-4590-8044-c49d1141771f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:49.156240 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bf5b53a-2c11-406f-b4a9-716a4439e836 req-e50cf0fd-4fa9-4590-8044-c49d1141771f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 932 time: 0.2335644
May 26 14:59:49.191507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-caac04a2-e658-4936-8283-c7fb4901903e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:49.192327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-caac04a2-e658-4936-8283-c7fb4901903e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:network {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:49.255973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-caac04a2-e658-4936-8283-c7fb4901903e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:network {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:49.255973 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-caac04a2-e658-4936-8283-c7fb4901903e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/networks?id=85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 200  len: 809 time: 0.3127468
May 26 14:59:49.260747 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bf5b53a-2c11-406f-b4a9-716a4439e836 req-15791fb7-683d-4669-a7e5-8e9ef73ee8d0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0970559
May 26 14:59:49.271718 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:49.278143 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-4a6081d9-703e-4623-a99e-1b89b85a9fc5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/quotas/dffd269c3a344d36b77ebb04d0c412e3 HTTP/1.1" status: 200  len: 375 time: 0.0168843
May 26 14:59:49.299915 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1060392281-network', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:49.327934 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-5d3452ed-fc9e-42c3-910a-911defb21172 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0477598
May 26 14:59:49.337190 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:49.349967 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Usage tracker for resource:network and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:49.354231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:49.363499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:49.478396 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-828e5740-4827-4c63-8412-3ac36b8ee067 service neutron] 10.222.0.81 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1419444
May 26 14:59:49.500551 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Made reservation on behalf of 07c65d1e254f424ebfea8360aa697c34 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:49.502855 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:49.540063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:49.610377 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-4a42b9f0-fd26-45d1-a7b5-67a5747b3cd6 service neutron] 10.222.0.81 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1257329
May 26 14:59:49.617873 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:49.630595 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:49.635800 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:49.657142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:49.667032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 req-36c3e3a3-6b6a-450f-9bba-43a693f444dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:49.668623 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 req-36c3e3a3-6b6a-450f-9bba-43a693f444dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2928355
May 26 14:59:49.759941 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 req-aaccdbe9-2056-4e02-a713-7814b9ce3873 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0785794
May 26 14:59:49.864029 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3ab2e391-3d42-467d-8e80-fe132717746c {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:49.877951 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:49.902398 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-68e2a2f1-47f0-4292-8011-8fdfa0e26558 req-f25bae92-215a-4f9f-b0f4-c4059bc6b817 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0638258
May 26 14:59:49.954283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:49.961039 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Transition to ACTIVE for port object 3ab2e391-3d42-467d-8e80-fe132717746c will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:50.003568 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5727e7ff-d5e3-45fc-a606-5395b577aea6 req-c21e5e2d-91d9-4c7f-ac87-8baec0cbecbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:50.005224 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5727e7ff-d5e3-45fc-a606-5395b577aea6 req-c21e5e2d-91d9-4c7f-ac87-8baec0cbecbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1060371
May 26 14:59:50.051050 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5727e7ff-d5e3-45fc-a606-5395b577aea6 req-0f329d8f-4421-4aa3-8600-a91616e1a0d7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0401313
May 26 14:59:50.053410 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.056350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c45677c8-f48f-4b22-8f40-7d930a6e388d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:50.085210 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.093508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1218}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 14:59:50.104274 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a611b0-6b0e-4059-8550-a67036619ed9,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:50.110397 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:50.112336 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2ded930e-2f16-474f-82ab-cc22456d2c45 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:50.202054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.202394 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Added segment d854f15e-4f6e-4459-9574-2252ec12295e of type vlan for network e30d7c90-8779-49cd-96d8-5c4ae28c55f9
May 26 14:59:50.249357 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Pushing event updated for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:50.286246 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 14:59:50.290428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:50.298612 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.395416 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Attempting to bind port 3ab2e391-3d42-467d-8e80-fe132717746c on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:50.395758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Attempting to bind port 3ab2e391-3d42-467d-8e80-fe132717746c by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:50.396084 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Attempting to bind port 3ab2e391-3d42-467d-8e80-fe132717746c on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:50.400830 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Port 3ab2e391-3d42-467d-8e80-fe132717746c on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:59:50.401142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Attempting to bind port 3ab2e391-3d42-467d-8e80-fe132717746c on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:50.406505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:50.406839 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Checking segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:50.407217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Bound using segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:50.407647 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Bound port: 3ab2e391-3d42-467d-8e80-fe132717746c, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:50.408023 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.495948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17853031-d653-4f51-a534-849e8c249579 req-9636464b-fb94-4705-9e40-bfb8fa376f6f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:50.497507 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-17853031-d653-4f51-a534-849e8c249579 req-9636464b-fb94-4705-9e40-bfb8fa376f6f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 944 time: 0.1055686
May 26 14:59:50.502867 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.506811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:50.507384 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.513610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:50.546644 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-17853031-d653-4f51-a534-849e8c249579 req-ca862487-70bc-497d-94c6-c9c8920f3bdb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0423691
May 26 14:59:50.567148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-47fc5d35-6ca9-4165-93e0-4688ddd73b46 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.672331 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Pushing event updated for resources: {'Network': ['ID=e30d7c90-8779-49cd-96d8-5c4ae28c55f9,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:50.675728 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:50.683075 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 14:59:50.690313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:50.693439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=3ab2e391-3d42-467d-8e80-fe132717746c,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:50.839270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58174) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:50.850114 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 1.8660183
May 26 14:59:50.854088 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Request body: {'subnet': {'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1060392281-subnet', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:50.856985 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.869001 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:50.883097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Usage tracker for resource:subnet and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:50.885198 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:50.893505 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:50.900709 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:50.996543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:50.997137 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:50.998515 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] 10.222.0.32 "PUT /v2.0/ports/3ab2e391-3d42-467d-8e80-fe132717746c HTTP/1.1" status: 200  len: 1094 time: 1.8888330
May 26 14:59:51.001153 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:51.005080 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7a1a6851-3558-4f5a-aa5a-6dd45b5998d3 req-1dd34b98-d9a4-4c1f-a595-9ba8337090a7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0492589
May 26 14:59:51.005901 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Made reservation on behalf of 07c65d1e254f424ebfea8360aa697c34 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:51.008747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:51.030902 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Pushing event updated for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:51.043406 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:51.069184 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d933f5e3-5e22-49c1-952f-159d98f0e857 req-46e7d3e1-5476-4cc3-a902-12cfcf511c1a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.070812 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d933f5e3-5e22-49c1-952f-159d98f0e857 req-46e7d3e1-5476-4cc3-a902-12cfcf511c1a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1525538
May 26 14:59:51.072660 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c', 'status': 'completed', 'code': 200}
May 26 14:59:51.172154 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d933f5e3-5e22-49c1-952f-159d98f0e857 req-cb6f4eb1-3f14-4907-813d-4808bbb5eb1f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0934403
May 26 14:59:51.212011 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-06b58e73-e055-4f08-a7c6-fdae48e2e7d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.213645 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-06b58e73-e055-4f08-a7c6-fdae48e2e7d9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 1097 time: 0.0939090
May 26 14:59:51.317912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43135e71-750c-496c-9d2f-19da9db98055 req-7933f4d9-8546-4d3c-93e9-36a2d03c3bef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.319399 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43135e71-750c-496c-9d2f-19da9db98055 req-7933f4d9-8546-4d3c-93e9-36a2d03c3bef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1330731
May 26 14:59:51.366118 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43135e71-750c-496c-9d2f-19da9db98055 req-f9402a9c-9e65-46ef-80e9-58017e991489 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0408843
May 26 14:59:51.374308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-45cdcbf4-eacd-400e-8f40-99f5a616b988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.376243 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-45cdcbf4-eacd-400e-8f40-99f5a616b988 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=1515325707f64d58a28f26451b2c74de&shared=False HTTP/1.1" status: 200  len: 917 time: 0.1429982
May 26 14:59:51.517197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-36bae5b3-30fe-43f9-ad71-aca2dc8d4e93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.518865 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-36bae5b3-30fe-43f9-ad71-aca2dc8d4e93 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1358385
May 26 14:59:51.608807 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:51.613225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:51.693834 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f8df0d21-cfe4-4e67-913c-771912dae169,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:51.697132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:51.707732 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Checking segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:51.708162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Network hostable DHCP agents. Network: e30d7c90-8779-49cd-96d8-5c4ae28c55f9, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 14:59:51.798287 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-8650e2b9-a057-4913-88dc-0ed41795a8ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.800884 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-8650e2b9-a057-4913-88dc-0ed41795a8ab service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 1097 time: 0.1390896
May 26 14:59:51.801885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 14:59:51.812592 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28f61610-b4a3-4cfb-be2f-842b10d63183 req-3d6c8e9b-6e56-4de9-9efa-4f7e2ee436bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.813990 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28f61610-b4a3-4cfb-be2f-842b10d63183 req-3d6c8e9b-6e56-4de9-9efa-4f7e2ee436bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 944 time: 0.1166728
May 26 14:59:51.893724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-2f4d0e51-d74a-442a-96e4-401288b93b79 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=3ab2e391-3d42-467d-8e80-fe132717746c HTTP/1.1" status: 200  len: 217 time: 0.0777175
May 26 14:59:51.921921 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, e30d7c90-8779-49cd-96d8-5c4ae28c55f9) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:51.930550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.931170 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:51.941947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7b9b25f1-9318-471b-8556-702921e0b023 None None] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:51.966251 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28f61610-b4a3-4cfb-be2f-842b10d63183 req-e81fbb79-dec2-4f73-b033-f0ec479ba5c9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1020474
May 26 14:59:51.987261 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-5fef6694-906d-45a0-a4f6-81a7521f9134 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:51.988724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-5fef6694-906d-45a0-a4f6-81a7521f9134 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 200  len: 855 time: 0.0831540
May 26 14:59:52.045211 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-ab5305d4-337e-4022-a677-1a41cc25cdbe service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=5bdb145e-267b-43cd-9426-f92f373c5ed5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0429399
May 26 14:59:52.088989 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0dfa8d74-835c-442d-8005-80b27eec6c69 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 1.2472057
May 26 14:59:52.096618 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58192) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:52.103392 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:52.108394 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:52.113635 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Usage tracker for resource:router and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:52.119630 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:52.128704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:52.193885 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4c704db3-a198-4eb0-a679-b1c5c45bf962 req-3cac3bd7-a23f-4ad5-bc0f-26858fa1ed43 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0538311
May 26 14:59:52.216248 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.216448 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 14:59:52.217527 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.218491 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.255563 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.284174 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-899b6a0f-a0ba-4528-961a-15443eb355d5 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2312429
May 26 14:59:52.406832 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Allocated IP 172.20.0.2 (e30d7c90-8779-49cd-96d8-5c4ae28c55f9/f8df0d21-cfe4-4e67-913c-771912dae169/740e718d-231f-4d65-bc95-2ee9f35b897c) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:52.519009 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 req-5c7a0c3f-126f-4cd8-977e-84426d7d44e8 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2213023
May 26 14:59:52.533997 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569141d2-b52c-483e-9e54-e85b9c03fba8 req-b72d0132-820a-4df7-8616-7466a8aa96b8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:52.536256 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-569141d2-b52c-483e-9e54-e85b9c03fba8 req-b72d0132-820a-4df7-8616-7466a8aa96b8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2118323
May 26 14:59:52.587323 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-569141d2-b52c-483e-9e54-e85b9c03fba8 req-b8312df2-c2ee-4339-93fd-fdf8a56ddea1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441003
May 26 14:59:52.675206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.685944 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Transition to ACTIVE for port object 740e718d-231f-4d65-bc95-2ee9f35b897c will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:52.705705 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Transition to ACTIVE for port object 740e718d-231f-4d65-bc95-2ee9f35b897c will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:52.756986 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.760983 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:52.815678 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:52.851322 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 req-a69d291e-64f0-4c9e-a1ce-8ea85a8abca5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:52.853012 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 req-a69d291e-64f0-4c9e-a1ce-8ea85a8abca5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.3053696
May 26 14:59:52.889044 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:52.892582 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:52.896470 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:52.946066 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Pushing event updated for resources: {'Port': ['ID=740e718d-231f-4d65-bc95-2ee9f35b897c,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:52.969914 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-cee6fa36-da76-4861-a860-956d448f2399 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:52.972565 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-cee6fa36-da76-4861-a860-956d448f2399 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "GET /v2.0/networks?id=85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 200  len: 809 time: 0.2963784
May 26 14:59:52.973026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:52.992812 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Request body: {'port': {'device_id': '017ce180-3d28-4cea-8c40-c113c3627273', 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a', 'admin_state_up': True, 'tenant_id': 'dffd269c3a344d36b77ebb04d0c412e3'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:53.005965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Attempting to bind port 740e718d-231f-4d65-bc95-2ee9f35b897c on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:53.006275 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Attempting to bind port 740e718d-231f-4d65-bc95-2ee9f35b897c by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:53.006695 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Attempting to bind port 740e718d-231f-4d65-bc95-2ee9f35b897c on network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:53.013131 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:53.013584 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Checking segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:53.014005 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.014580 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Bound using segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:53.015169 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Bound port: 740e718d-231f-4d65-bc95-2ee9f35b897c, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:53.015621 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.040099 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 req-464bd112-2154-4da4-844b-fc67600b8515 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1758919
May 26 14:59:53.179661 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.189801 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] For port 740e718d-231f-4d65-bc95-2ee9f35b897c, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:53.193672 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] For port 740e718d-231f-4d65-bc95-2ee9f35b897c, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=740e718d-231f-4d65-bc95-2ee9f35b897c,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:53.235459 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-180b4556-68a9-40ba-b793-a414ce1f3ca4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.271571 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 14:59:53.278223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Usage tracker for resource:port and tenant:dffd269c3a344d36b77ebb04d0c412e3 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 14:59:53.281369 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Quota usage for port was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 14:59:53.288227 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 14:59:53.334872 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.341410 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:53.363312 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 req-b7d37b75-ab7b-4ede-a317-2b9b1e375f25 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:53.366686 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 req-b7d37b75-ab7b-4ede-a317-2b9b1e375f25 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 944 time: 0.2528319
May 26 14:59:53.405758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Made reservation on behalf of dffd269c3a344d36b77ebb04d0c412e3 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 14:59:53.410729 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.433041 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d req-53eb2951-9378-4b4a-adb2-105fd13c17d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0896778
May 26 14:59:53.439519 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Pushing event updated for resources: {'Port': ['ID=740e718d-231f-4d65-bc95-2ee9f35b897c,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:53.454407 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:53.501899 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.536408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.549882 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 req-0a95efd4-1ffe-497d-9177-0b8a9ce0b940 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1755099
May 26 14:59:53.668186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Allocated IP 172.20.0.5 (85b44080-2458-40a2-bbbd-894b0448370a/1ffbc503-b2cb-4a9f-8705-0778bedb7314/717c230d-741b-4c4f-abf3-9fd63dc119c4) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:53.702991 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Allocated IP 172.27.2.131 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/62f5a1b2-488b-45ed-b46e-e4fab6772517) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:53.928036 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.939569 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:53.946194 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef006ad-9608-4ec8-a5a8-8f462b876239 req-22d08faf-b3fc-4492-9c2a-651c6573ffa6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:53.947728 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eef006ad-9608-4ec8-a5a8-8f462b876239 req-22d08faf-b3fc-4492-9c2a-651c6573ffa6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1408572
May 26 14:59:54.004857 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eef006ad-9608-4ec8-a5a8-8f462b876239 req-9d4363d4-b4f8-4ad8-8791-ba0f1f64c729 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0479419
May 26 14:59:54.042121 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.042644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.047941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:54.095440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.100467 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:54.116431 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Network 85b44080-2458-40a2-bbbd-894b0448370a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:54.119560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:54.123586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:54.163994 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 14:59:54.166911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 14:59:54.170898 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 14:59:54.171063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Pushing event updated for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:54.210638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:54.211310 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Pushing event updated for resources: {'Port': ['ID=62f5a1b2-488b-45ed-b46e-e4fab6772517,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:54.220188 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:54.255499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:54.256111 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.311743 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6163928-c2ec-4676-a4a6-e5df0edf221b req-e0334281-5494-41dd-8a35-cee1b4bce907 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:54.319478 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6163928-c2ec-4676-a4a6-e5df0edf221b req-e0334281-5494-41dd-8a35-cee1b4bce907 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1543431
May 26 14:59:54.371729 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6163928-c2ec-4676-a4a6-e5df0edf221b req-7ec9b27a-e5ab-4667-9031-7583e33aaeda tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505385
May 26 14:59:54.373366 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3850365
May 26 14:59:54.393713 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Request body: {'port': {'device_id': '017ce180-3d28-4cea-8c40-c113c3627273', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 14:59:54.608101 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.638028 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8019250c-7819-4096-8256-50f6d69d6818 None None] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 14:59:54.789137 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331b0d13-0c69-422f-bcdb-9819340cec44 req-cfbab117-32b5-4220-ae4e-90192b5c65b6 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:54.790009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-331b0d13-0c69-422f-bcdb-9819340cec44 req-cfbab117-32b5-4220-ae4e-90192b5c65b6 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:54.842971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:54.880422 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f9a8510b-ed4f-4474-896d-086b629149d5 None None] Provisioning for port 740e718d-231f-4d65-bc95-2ee9f35b897c completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:54.906849 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-331b0d13-0c69-422f-bcdb-9819340cec44 req-cfbab117-32b5-4220-ae4e-90192b5c65b6 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:54.908105 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-331b0d13-0c69-422f-bcdb-9819340cec44 req-cfbab117-32b5-4220-ae4e-90192b5c65b6 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 931 time: 0.3355541
May 26 14:59:55.004269 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-331b0d13-0c69-422f-bcdb-9819340cec44 req-90a3c56a-a8e3-401b-9b54-1614ca5bb8c2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0878267
May 26 14:59:55.036219 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 740e718d-231f-4d65-bc95-2ee9f35b897c up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:55.218687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 717c230d-741b-4c4f-abf3-9fd63dc119c4 {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:55.231532 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.255994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Transition to ACTIVE for port object 717c230d-741b-4c4f-abf3-9fd63dc119c4 will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:55.264576 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 740e718d-231f-4d65-bc95-2ee9f35b897c completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 14:59:55.272063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 req-33167f03-6fc3-47df-9f1a-7edcb34c1c5c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:55.272231 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 740e718d-231f-4d65-bc95-2ee9f35b897c triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:55.272509 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.273579 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 req-33167f03-6fc3-47df-9f1a-7edcb34c1c5c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 944 time: 0.1393378
May 26 14:59:55.326512 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 req-0b10b036-610b-4b56-b9aa-a727ecc78270 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464435
May 26 14:59:55.339920 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-45804374-e18d-44d7-a721-f2e0ba8e912d None None] Provisioning complete for port 740e718d-231f-4d65-bc95-2ee9f35b897c triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:55.340307 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-45804374-e18d-44d7-a721-f2e0ba8e912d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.356183 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.363860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-64e671cd-90ab-4e5b-b7af-5c98e065e890 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:55.398440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.484353 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.584198 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-45804374-e18d-44d7-a721-f2e0ba8e912d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.605758 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 740e718d-231f-4d65-bc95-2ee9f35b897c, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=740e718d-231f-4d65-bc95-2ee9f35b897c,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:55.624900 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.634314 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f req-590a922f-2ef4-4dec-8ce6-9c5e3e72f96b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:55.639187 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f req-590a922f-2ef4-4dec-8ce6-9c5e3e72f96b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.3855829
May 26 14:59:55.646373 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-c86103c5-6de9-4293-b9ab-5f698b24d5b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:55.647801 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-c86103c5-6de9-4293-b9ab-5f698b24d5b4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.3450098
May 26 14:59:55.668894 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.670842 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:55.690066 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Pushing event updated for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:55.718763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.355s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:55.777783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bffcaf8-711b-4f1e-918f-9c48f277e33b req-844bf606-b5e4-4b2d-b7c8-74935de9fc3e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:55.785502 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5bffcaf8-711b-4f1e-918f-9c48f277e33b req-844bf606-b5e4-4b2d-b7c8-74935de9fc3e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2103601
May 26 14:59:55.790395 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=740e718d-231f-4d65-bc95-2ee9f35b897c,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:55.794327 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:55.795517 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.db.api [None req-45804374-e18d-44d7-a721-f2e0ba8e912d None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103983) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 26 14:59:55.796776 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_db.api [None req-45804374-e18d-44d7-a721-f2e0ba8e912d None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 26 14:59:55.804079 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f req-18bbc008-6f03-4a6b-be93-1ddd1202034d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1553063
May 26 14:59:55.805431 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Attempting to bind port 717c230d-741b-4c4f-abf3-9fd63dc119c4 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:55.805799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Attempting to bind port 717c230d-741b-4c4f-abf3-9fd63dc119c4 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:55.806130 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Attempting to bind port 717c230d-741b-4c4f-abf3-9fd63dc119c4 on network 85b44080-2458-40a2-bbbd-894b0448370a {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:55.816420 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Port 717c230d-741b-4c4f-abf3-9fd63dc119c4 on network 85b44080-2458-40a2-bbbd-894b0448370a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 14:59:55.816982 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Attempting to bind port 717c230d-741b-4c4f-abf3-9fd63dc119c4 on network 85b44080-2458-40a2-bbbd-894b0448370a {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:55.830863 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:55.833114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Checking segment: {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:55.833114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Bound using segment: {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:55.833114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Bound port: 717c230d-741b-4c4f-abf3-9fd63dc119c4, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:55.833114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:55.867708 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5bffcaf8-711b-4f1e-918f-9c48f277e33b req-1a46956f-be8f-4738-8a23-aa18441217ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0811076
May 26 14:59:55.877747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-27c81448-2653-43f7-9317-a4ffeaca5234 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:55.880558 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-27c81448-2653-43f7-9317-a4ffeaca5234 service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.2119920
May 26 14:59:55.968531 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:55.972550 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:56.024932 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 14:59:56.033007 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-2ffd6db4-4aa0-429d-82a1-b138a9232b19 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.1291623
May 26 14:59:56.043320 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:56.048480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-26747a28-52a6-4379-b2b2-5be110b12223 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:56.108250 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.108936 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:56.110445 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] 10.222.0.32 "PUT /v2.0/ports/717c230d-741b-4c4f-abf3-9fd63dc119c4 HTTP/1.1" status: 200  len: 1093 time: 1.7229314
May 26 14:59:56.110954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:56.175963 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Pushing event updated for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:56.180828 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:56.277929 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 req-96f6e120-fc0a-4d4e-ab18-d54f55723b97 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.279420 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 req-96f6e120-fc0a-4d4e-ab18-d54f55723b97 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 943 time: 0.1451516
May 26 14:59:56.303361 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-95b450e1-3507-4a5b-a044-8b198744a87b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.304919 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-95b450e1-3507-4a5b-a044-8b198744a87b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.2022099
May 26 14:59:56.315817 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-935e8b52-9658-4a77-aee1-2e83ae3c3f72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.317298 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-935e8b52-9658-4a77-aee1-2e83ae3c3f72 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 1096 time: 0.1099374
May 26 14:59:56.371402 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 req-9ff172f7-3e21-4097-bb4e-25f6419c8f5b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.372860 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 req-9ff172f7-3e21-4097-bb4e-25f6419c8f5b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.3907461
May 26 14:59:56.374098 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 14:59:56.377609 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-896846d5-5bb7-4523-9048-a575a724ed5b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0635512
May 26 14:59:56.386655 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Sync routers for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 14:59:56.397211 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:59:56.397999 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4ba3b20>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:56.398142 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 req-b4418f71-4ac2-4b4b-877e-02de5e742f35 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1110542
May 26 14:59:56.399440 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-e30521c2-bf22-4114-96d5-77ed6ba9bc7c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4 HTTP/1.1" status: 200  len: 217 time: 0.0666966
May 26 14:59:56.465980 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4', 'status': 'completed', 'code': 200}
May 26 14:59:56.477408 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-09449bd9-62b2-4d31-ae38-a613f65ad401 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.478935 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-09449bd9-62b2-4d31-ae38-a613f65ad401 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1ffbc503-b2cb-4a9f-8705-0778bedb7314 HTTP/1.1" status: 200  len: 849 time: 0.0727596
May 26 14:59:56.536553 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-52a55b25-afe3-4db2-84fb-9023e23db3c5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=85b44080-2458-40a2-bbbd-894b0448370a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0460184
May 26 14:59:56.613419 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:59:56.614671 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:56.619780 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 921 time: 4.5178449
May 26 14:59:56.625398 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58252) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 14:59:56.638136 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 req-aff85f70-b896-47b6-886c-70f462dbb312 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2563992
May 26 14:59:56.689797 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-3698f2d2-8644-44e2-9670-8f3e8a276a8d service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1807306
May 26 14:59:56.886010 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b55f58e4-3e39-4378-9ff4-53f9632f9481 req-d05ff5dc-83eb-4a0a-a438-6ce5d549dbf1 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1663899
May 26 14:59:56.888742 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 3ab2e391-3d42-467d-8e80-fe132717746c details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:59:56.968964 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-17a027fe-3c93-47db-9d83-5c3a6f9d4f4c service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4056458
May 26 14:59:56.982424 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df542c50-fa6b-43fe-b08d-fba33932cf05 req-e6ffd4dc-4a78-46c8-8945-9ada521df200 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:56.990075 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-df542c50-fa6b-43fe-b08d-fba33932cf05 req-e6ffd4dc-4a78-46c8-8945-9ada521df200 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 944 time: 0.4289985
May 26 14:59:57.078478 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=3ab2e391-3d42-467d-8e80-fe132717746c,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:57.088526 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 740e718d-231f-4d65-bc95-2ee9f35b897c up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:57.108293 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4ba3b20>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T14:59:54Z', 'revision_number': 3, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T14:59:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:57.118017 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Checking router: 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 14:59:57.118619 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Updating router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 port 62f5a1b2-488b-45ed-b46e-e4fab6772517 binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 14:59:57.136703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 req-037c14cc-00be-4c29-b007-26591595b649 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:57.145127 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 req-037c14cc-00be-4c29-b007-26591595b649 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1257219
May 26 14:59:57.171706 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '3ab2e391-3d42-467d-8e80-fe132717746c', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'port_id': '3ab2e391-3d42-467d-8e80-fe132717746c', 'mac_address': 'fa:16:3e:0b:1a:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a5c1fbe6-787f-4fc0-9f39-1179f60b94a5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:59:57.175199 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 740e718d-231f-4d65-bc95-2ee9f35b897c triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:57.176225 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.206264 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 req-c807d5b3-ecf2-447a-ad6d-83f6d8adb213 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0599210
May 26 14:59:57.225105 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-df542c50-fa6b-43fe-b08d-fba33932cf05 req-e0adcddb-253a-4cf0-abe0-1cf3b4476eda tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2337031
May 26 14:59:57.250051 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.300698 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.319934 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3ab2e391-3d42-467d-8e80-fe132717746c {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:57.338805 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=3ab2e391-3d42-467d-8e80-fe132717746c,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:57.439662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06908040-0183-4cb9-b5ba-d7f37e02b236 req-481004ef-3b07-41e3-b468-cb461c3f1fdf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:57.441492 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-06908040-0183-4cb9-b5ba-d7f37e02b236 req-481004ef-3b07-41e3-b468-cb461c3f1fdf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1131029
May 26 14:59:57.448054 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.449103 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 14:59:57.453811 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:57.500081 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c689254-dd30-4df1-a923-3ad576e0ad54 req-a1720b6c-7344-4f3e-ba52-2158516489d9 service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4936519
May 26 14:59:57.548176 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-06908040-0183-4cb9-b5ba-d7f37e02b236 req-4ee31ab8-c1a1-4d4d-9faa-f88e793ca0dd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0988994
May 26 14:59:57.576431 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:57.586000 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:57.730057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.829133 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.843897 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:57.862928 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Transition to ACTIVE for port object 62f5a1b2-488b-45ed-b46e-e4fab6772517 will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 14:59:57.878969 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'e948d481-711f-45b8-8deb-08b7658709e7', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 14:59:57.894045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 req-3f500bc7-e0e7-4404-b3c8-ea4bd5bb27c5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:57.895655 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 req-3f500bc7-e0e7-4404-b3c8-ea4bd5bb27c5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 943 time: 0.2926888
May 26 14:59:57.961746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-8a77c35d-bc81-46c1-9fa8-6e194b26e983 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:57.963401 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-8a77c35d-bc81-46c1-9fa8-6e194b26e983 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1098 time: 0.2492886
May 26 14:59:57.991677 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-c97f97b1-3b75-47ea-a1f9-49804ad6312b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:57.992036 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:57.993146 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-c97f97b1-3b75-47ea-a1f9-49804ad6312b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 1096 time: 0.3405485
May 26 14:59:57.996463 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9c38af-895b-4e23-9093-03878e603401 req-b12ee789-d782-4102-815e-8dc41cdf7e26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.002150 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.009957 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5bb92411-80cd-4548-b5da-9675957ff4e6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:58.014143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 14:59:58.014282 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2c9c38af-895b-4e23-9093-03878e603401 req-b12ee789-d782-4102-815e-8dc41cdf7e26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1244931
May 26 14:59:58.035167 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:58.050658 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 req-afeddcc4-98ae-45dd-8ed8-db5153fe340b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1041458
May 26 14:59:58.112443 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Attempting to bind port 62f5a1b2-488b-45ed-b46e-e4fab6772517 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 14:59:58.112817 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Attempting to bind port 62f5a1b2-488b-45ed-b46e-e4fab6772517 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 14:59:58.113178 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Attempting to bind port 62f5a1b2-488b-45ed-b46e-e4fab6772517 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 14:59:58.119226 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Pushing event updated for resources: {'Port': ['ID=62f5a1b2-488b-45ed-b46e-e4fab6772517,revision_number=2']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:58.122361 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.124411 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 14:59:58.124781 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 14:59:58.125253 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.125592 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 14:59:58.126064 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Bound port: 62f5a1b2-488b-45ed-b46e-e4fab6772517, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 14:59:58.126472 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.130755 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:58.167172 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.167572 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.167854 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.168177 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.168492 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.168860 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.169226 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.169587 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.169908 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.170221 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.170527 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.170830 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:58.180896 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:58.187543 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2c9c38af-895b-4e23-9093-03878e603401 req-a36bab61-8d1f-4be4-9978-8a6022e37f43 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1724043
May 26 14:59:58.233881 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] For port 62f5a1b2-488b-45ed-b46e-e4fab6772517, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 14:59:58.238015 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] For port 62f5a1b2-488b-45ed-b46e-e4fab6772517, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=62f5a1b2-488b-45ed-b46e-e4fab6772517,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 14:59:58.239596 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=6']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:58.242625 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:58.250478 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-50b96956-bd7a-407e-8882-6d123c79a0c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.253247 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-50b96956-bd7a-407e-8882-6d123c79a0c9 service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.2364206
May 26 14:59:58.288733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e948d481-711f-45b8-8deb-08b7658709e7'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:58.337908 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-e03de867-7132-466f-885a-4e08453a12bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.339459 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-e03de867-7132-466f-885a-4e08453a12bd service neutron] 10.222.0.32 "GET /v2.0/networks?id=85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 200  len: 911 time: 0.3211603
May 26 14:59:58.350960 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.364984 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:58.448561 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-8eacca48-ab1a-4d8d-9c9d-4d417a55f0d8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 1000 time: 0.1796134
May 26 14:59:58.480997 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:58.546999 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-5299649a-67aa-4ec4-a71a-07cfad4f4190 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4 HTTP/1.1" status: 200  len: 217 time: 0.1855929
May 26 14:59:58.592005 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-7a6f85a4-0385-4e91-99d7-d25a831e6fc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.593444 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-7a6f85a4-0385-4e91-99d7-d25a831e6fc9 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.1031389
May 26 14:59:58.594940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 14:59:58.596305 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4ba3b20>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:58.623465 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['3ab2e391-3d42-467d-8e80-fe132717746c'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 14:59:58.647943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288e6910-094f-4cec-8a52-29222e81e516 req-c549ca5e-8489-4297-a927-170d6414af2e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.655184 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-288e6910-094f-4cec-8a52-29222e81e516 req-c549ca5e-8489-4297-a927-170d6414af2e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 945 time: 0.2166309
May 26 14:59:58.735558 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-288e6910-094f-4cec-8a52-29222e81e516 req-9fec1fcd-d9e4-4c0d-8d85-552c70922542 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0792234
May 26 14:59:58.763309 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-32cebb8c-92d0-410d-a797-fd8baa38d3ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:58.765054 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-32cebb8c-92d0-410d-a797-fd8baa38d3ae service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1620286
May 26 14:59:58.890277 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 14:59:58.914855 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 14:59:59.046774 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-93694b52-f706-4836-9707-f09b873a4739 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2677982
May 26 14:59:59.084657 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94df9921-7e62-4285-8680-00e18085b5ed req-8bd3bd10-46a7-4995-8ef8-3dcd8ddce882 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:59.096730 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-94df9921-7e62-4285-8680-00e18085b5ed req-8bd3bd10-46a7-4995-8ef8-3dcd8ddce882 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1750679
May 26 14:59:59.099826 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port e948d481-711f-45b8-8deb-08b7658709e7 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 14:59:59.100850 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:59.174458 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-d28080ba-74df-4485-acef-96a2e0435724 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:59.175919 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-d28080ba-74df-4485-acef-96a2e0435724 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1ffbc503-b2cb-4a9f-8705-0778bedb7314 HTTP/1.1" status: 200  len: 849 time: 0.6111386
May 26 14:59:59.240034 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-8b27cfa5-eca8-4bf5-a787-61de738d7116 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=85b44080-2458-40a2-bbbd-894b0448370a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0509939
May 26 14:59:59.244873 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-94df9921-7e62-4285-8680-00e18085b5ed req-18771447-6044-405f-b14a-8291ac8c1714 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1436970
May 26 14:59:59.293909 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f70192-4315-41b8-a749-bfbb2ab0ee28 req-3fb8089c-a9c7-41a3-9f06-93567252cf39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:59.301310 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-97f70192-4315-41b8-a749-bfbb2ab0ee28 req-3fb8089c-a9c7-41a3-9f06-93567252cf39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.8224337
May 26 14:59:59.342851 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bbabbcb5-5525-4582-b410-9019550da1f8 req-df06406c-e306-4c72-a2c2-cc9589ef89bb service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2863145
May 26 14:59:59.369709 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Pushing event updated for resources: {'Port': ['ID=62f5a1b2-488b-45ed-b46e-e4fab6772517,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:59.378932 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.015s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:59.444444 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-13612d20-2907-45be-a987-8599f586a5ea None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4ba3b20>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T14:59:54Z', 'revision_number': 3, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T14:59:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 14:59:59.448722 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13612d20-2907-45be-a987-8599f586a5ea None None] The sync data for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi is: [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T14:59:54Z', 'revision_number': 3, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T14:59:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 14:59:59.491643 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-97f70192-4315-41b8-a749-bfbb2ab0ee28 req-f902021f-5c05-44fe-a2c1-95599e35bd79 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1880863
May 26 14:59:59.494968 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:59.518749 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Allocated IP 172.20.0.1 (e30d7c90-8779-49cd-96d8-5c4ae28c55f9/f8df0d21-cfe4-4e67-913c-771912dae169/093539a9-fe4c-473b-afed-760a8fa8122e) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 14:59:59.553869 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 14:59:59.580375 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 14:59:59.660106 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 14:59:59.663064 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 14:59:59.681562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771eef87-b22c-49e9-9f03-c477559ba77c req-f578604f-cc4a-4722-b4f8-a2272902c52c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 14:59:59.688812 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-771eef87-b22c-49e9-9f03-c477559ba77c req-f578604f-cc4a-4722-b4f8-a2272902c52c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 943 time: 0.2735090
May 26 14:59:59.749018 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-771eef87-b22c-49e9-9f03-c477559ba77c req-64d7ae47-1df5-4370-9737-3b261f5d4a83 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 14:59:59.775121 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-76be3e65-5a16-4042-a702-fb2956057fd0 service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4483879
May 26 14:59:59.789574 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=7']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 14:59:59.891982 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-771eef87-b22c-49e9-9f03-c477559ba77c req-64d7ae47-1df5-4370-9737-3b261f5d4a83 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 14:59:59.891982 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-771eef87-b22c-49e9-9f03-c477559ba77c req-64d7ae47-1df5-4370-9737-3b261f5d4a83 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1697218
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.927096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 14:59:59.946239 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.283s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 14:59:59.997401 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'code': 200}
May 26 15:00:00.221097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d7f320-f504-408b-9fe1-e56ee5b80c07 req-f883405e-29f4-4247-a0c9-a05eb24b5013 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:00.233481 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-74d7f320-f504-408b-9fe1-e56ee5b80c07 req-f883405e-29f4-4247-a0c9-a05eb24b5013 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 945 time: 0.1253843
May 26 15:00:00.271361 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-7c4cd58c-38ed-4a67-9f42-2a341e099cb4 service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4465463
May 26 15:00:00.322232 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-74d7f320-f504-408b-9fe1-e56ee5b80c07 req-7bd819df-3461-49d1-87e2-b79a94180a8d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0819285
May 26 15:00:00.347872 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:00.372737 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Transition to ACTIVE for port object 093539a9-fe4c-473b-afed-760a8fa8122e will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:00.387117 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b5f3623-6063-46ba-aae6-df0bac9ae492 req-49476dea-c67c-40cb-8747-fb3f5372d738 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:00.395286 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b5f3623-6063-46ba-aae6-df0bac9ae492 req-49476dea-c67c-40cb-8747-fb3f5372d738 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.6367612
May 26 15:00:00.478861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b5f3623-6063-46ba-aae6-df0bac9ae492 req-aa2f8135-057f-4ba8-a8ec-649429b6339a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0824082
May 26 15:00:00.562773 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:00.582849 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:00.601828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3732777-efe0-47bd-8251-10e805be16ff req-732a4b28-6c9b-4f5e-94ec-a508dc6ddd45 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:00.604648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3732777-efe0-47bd-8251-10e805be16ff req-732a4b28-6c9b-4f5e-94ec-a508dc6ddd45 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1263587
May 26 15:00:00.655986 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3732777-efe0-47bd-8251-10e805be16ff req-140fb38e-5012-40f9-a290-fafad3a5b1d3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434604
May 26 15:00:00.697647 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:00.706796 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:00.709348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:00.805758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Pushing event updated for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:00.811212 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:00.826169 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:00.870513 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76b8cde7-0e85-4b41-a587-a78ede687857 req-36267e3b-6ee1-4758-bf2e-d020bd4c1199 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:00.870513 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-76b8cde7-0e85-4b41-a587-a78ede687857 req-36267e3b-6ee1-4758-bf2e-d020bd4c1199 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2086439
May 26 15:00:00.915603 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 717c230d-741b-4c4f-abf3-9fd63dc119c4 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:00:00.915603 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 3ab2e391-3d42-467d-8e80-fe132717746c up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:01.008024 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-76b8cde7-0e85-4b41-a587-a78ede687857 req-2f0af198-6339-478f-91c9-aa775d6963a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1368804
May 26 15:00:01.105611 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 62f5a1b2-488b-45ed-b46e-e4fab6772517 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:01.180388 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.237395 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 3ab2e391-3d42-467d-8e80-fe132717746c completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:01.272245 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 req-7a01f3f9-be2b-4433-b027-54f558bbe85d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:01.279070 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 req-7a01f3f9-be2b-4433-b027-54f558bbe85d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 943 time: 0.1416290
May 26 15:00:01.288141 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 3ab2e391-3d42-467d-8e80-fe132717746c triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:01.288609 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.348706 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 req-0b385380-4ef5-4336-98f5-4f67eda299a0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0619299
May 26 15:00:01.527658 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c8c0e009-e9ea-411a-87a6-c176b55e2a57 None None] Provisioning for port 093539a9-fe4c-473b-afed-760a8fa8122e completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:01.604461 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c8c0e009-e9ea-411a-87a6-c176b55e2a57 None None] Provisioning complete for port 093539a9-fe4c-473b-afed-760a8fa8122e triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:01.604891 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c8c0e009-e9ea-411a-87a6-c176b55e2a57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.686287 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:01.699441 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.711384 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 62f5a1b2-488b-45ed-b46e-e4fab6772517 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:01.730507 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe1ba21b-a58d-439c-878e-971f1d122280 req-5f8c4d3a-ae96-4b5f-a27a-b165eb7efaf8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:01.732938 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fe1ba21b-a58d-439c-878e-971f1d122280 req-5f8c4d3a-ae96-4b5f-a27a-b165eb7efaf8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 945 time: 0.1629333
May 26 15:00:01.739947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 62f5a1b2-488b-45ed-b46e-e4fab6772517 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:01.742736 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.808294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.811073 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '717c230d-741b-4c4f-abf3-9fd63dc119c4', 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a', 'port_id': '717c230d-741b-4c4f-abf3-9fd63dc119c4', 'mac_address': 'fa:16:3e:ac:ef:b0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1239, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1ffbc503-b2cb-4a9f-8705-0778bedb7314', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:00:01.847617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:01.897231 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.920258 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-c8c0e009-e9ea-411a-87a6-c176b55e2a57 None None] Port 093539a9-fe4c-473b-afed-760a8fa8122e cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:00:01.928941 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fe1ba21b-a58d-439c-878e-971f1d122280 req-0ae07dd2-7693-48e5-b075-126406de191d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1851962
May 26 15:00:01.935849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.968586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:01.972373 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 717c230d-741b-4c4f-abf3-9fd63dc119c4 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:01.991620 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=3ab2e391-3d42-467d-8e80-fe132717746c,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:02.020288 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:02.033776 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:02.064953 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:02.088727 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 62f5a1b2-488b-45ed-b46e-e4fab6772517, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=62f5a1b2-488b-45ed-b46e-e4fab6772517,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:02.097424 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Pushing event updated for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:02.102933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:02.107190 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:02.139251 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.291s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:02.188658 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:02.200394 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:02.209072 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:02.212488 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:02.213116 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-b606a653-bea2-4e8c-bd77-33df1e3fcf31 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.019s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:02.231801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:02.238534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:02.252460 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b95194b-63d9-4ec2-860f-926ef48a7137 req-7e3b25f0-5faf-4d7d-a048-a798003d88bf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:02.267331 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1b95194b-63d9-4ec2-860f-926ef48a7137 req-7e3b25f0-5faf-4d7d-a048-a798003d88bf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1831598
May 26 15:00:02.375281 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:02.451724 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1b95194b-63d9-4ec2-860f-926ef48a7137 req-9013729b-89d7-406b-975a-acbbe790c2ec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1831923
May 26 15:00:02.459300 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=62f5a1b2-488b-45ed-b46e-e4fab6772517,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:02.462586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:02.463263 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.259s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:02.463675 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:02.572407 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-589a9737-d934-4584-9092-ac46c2376ff0 None None] Provisioning complete for port 093539a9-fe4c-473b-afed-760a8fa8122e triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:02.573172 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-589a9737-d934-4584-9092-ac46c2376ff0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:02.661439 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-589a9737-d934-4584-9092-ac46c2376ff0 None None] Port 093539a9-fe4c-473b-afed-760a8fa8122e cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:00:02.664591 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['717c230d-741b-4c4f-abf3-9fd63dc119c4'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:00:02.687335 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:00:02.938627 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c', 'code': 200}
May 26 15:00:03.024525 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d80c114-7ddc-4ca8-8465-f1f93a80945c req-1e41a0e5-5a62-4fdf-9f2d-ea78e0399493 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.035372 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2d80c114-7ddc-4ca8-8465-f1f93a80945c req-1e41a0e5-5a62-4fdf-9f2d-ea78e0399493 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.3912287
May 26 15:00:03.049707 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 62f5a1b2-488b-45ed-b46e-e4fab6772517 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:03.103416 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:00:03.121688 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2d80c114-7ddc-4ca8-8465-f1f93a80945c req-0d49857c-0d1e-4693-a10f-775ee0bb64e8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0775306
May 26 15:00:03.157630 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] 10.222.0.81 "PUT /v2.0/routers/21afcaa4-cfbc-4718-bbaf-c9f06d0940e0/add_router_interface HTTP/1.1" status: 200  len: 503 time: 6.5272670
May 26 15:00:03.167582 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Sync routers for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:00:03.222097 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:03.222735 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabffdcb80>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:03.286244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86ad0f39-2cb0-48f7-8934-411599a7acc0 req-2d33f1d8-5f80-43da-a7f6-3575bf55c802 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.294804 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-86ad0f39-2cb0-48f7-8934-411599a7acc0 req-2d33f1d8-5f80-43da-a7f6-3575bf55c802 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2145860
May 26 15:00:03.409346 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-86ad0f39-2cb0-48f7-8934-411599a7acc0 req-c7f89c17-57ba-4a9c-a73d-5a8c354cd5f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1132770
May 26 15:00:03.482986 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 62f5a1b2-488b-45ed-b46e-e4fab6772517 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:03.483443 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:03.585577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c68105-478b-4dfd-b65e-d503a6f58fc3 req-146a0c76-53bf-4060-a5ef-6003105c86f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.586269 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:03.587234 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-50c68105-478b-4dfd-b65e-d503a6f58fc3 req-146a0c76-53bf-4060-a5ef-6003105c86f9 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 1099 time: 0.1373999
May 26 15:00:03.597143 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014d4854-1925-4f45-8f61-b104a21203b4 req-14aa7049-7225-4333-b543-4b53968ebdcc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.598693 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-014d4854-1925-4f45-8f61-b104a21203b4 req-14aa7049-7225-4333-b543-4b53968ebdcc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 944 time: 0.2601368
May 26 15:00:03.694240 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-014d4854-1925-4f45-8f61-b104a21203b4 req-881e83f0-4493-42d1-807c-265808f55edb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643752
May 26 15:00:03.702675 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-50c68105-478b-4dfd-b65e-d503a6f58fc3 req-899dba36-1a7a-431e-98ec-f7e870c1a1a9 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1029522
May 26 15:00:03.730311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c6daee5-f7fe-4b75-ba96-5e450d993754 req-45b155a3-1704-454a-a95c-f2184e61b393 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.738666 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6c6daee5-f7fe-4b75-ba96-5e450d993754 req-45b155a3-1704-454a-a95c-f2184e61b393 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.1275442
May 26 15:00:03.799917 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6c6daee5-f7fe-4b75-ba96-5e450d993754 req-f13e2517-7db5-4183-96d5-0c2d90e92a89 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600963
May 26 15:00:03.920120 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c11f9631-f4e9-4042-b223-7919bff613e0 req-79861920-3961-4d92-98d0-76d62317d0be tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:03.922463 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c11f9631-f4e9-4042-b223-7919bff613e0 req-79861920-3961-4d92-98d0-76d62317d0be tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1110168
May 26 15:00:04.006861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c11f9631-f4e9-4042-b223-7919bff613e0 req-7553fa3f-8638-4522-94c7-dc6b39484bbe tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0781898
May 26 15:00:04.148069 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabffdcb80>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:01Z', 'revision_number': 2, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:04.152067 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Checking router: 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:00:04.152425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Updating router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 port 093539a9-fe4c-473b-afed-760a8fa8122e binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:00:04.214785 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:04.307706 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7089e0-8b07-4766-ad96-d2422317bc63 req-d3390ffb-659b-42f9-8e07-a57a7e7861e1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:04.309169 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0b7089e0-8b07-4766-ad96-d2422317bc63 req-d3390ffb-659b-42f9-8e07-a57a7e7861e1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0814717
May 26 15:00:04.355966 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0b7089e0-8b07-4766-ad96-d2422317bc63 req-c7e8ed9f-8c8f-423d-beb8-2289e4967f63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401611
May 26 15:00:04.572199 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:04.584935 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Transition to ACTIVE for port object 093539a9-fe4c-473b-afed-760a8fa8122e will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:04.637928 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada1ce10-c94d-4af3-839a-c70b547a67c7 req-47525ac1-9008-4a9e-be37-1e89334a4fe0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:04.646003 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ada1ce10-c94d-4af3-839a-c70b547a67c7 req-47525ac1-9008-4a9e-be37-1e89334a4fe0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0965002
May 26 15:00:04.658541 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:04.663276 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:04.697244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58376) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:04.703403 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1907873096-network', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:04.737582 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ada1ce10-c94d-4af3-839a-c70b547a67c7 req-14c0f9da-dcbe-4659-945b-153c407917f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0904310
May 26 15:00:04.743096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:04.762724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Usage tracker for resource:network and tenant:e45a0526c7fe43899d670e392bac47de is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:04.774507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:04.795504 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:04.878468 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Made reservation on behalf of e45a0526c7fe43899d670e392bac47de for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:00:04.883021 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:04.947924 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 717c230d-741b-4c4f-abf3-9fd63dc119c4 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:05.007869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.040072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:05.051261 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Usage tracker for resource:security_group_rule and tenant:e45a0526c7fe43899d670e392bac47de is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:05.055417 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:05.064225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:05.079969 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Pushing event updated for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:05.084318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.421s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:05.178502 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90225932-269f-4052-a695-194031d20871 req-cffc06e0-a56b-4d0d-a69f-d3dcfb99420a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:05.185324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da16f4df-f831-404b-a26e-7a6d8124e71a req-21afce5e-c261-4e13-b9b4-aadd17e1201a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:05.186408 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-90225932-269f-4052-a695-194031d20871 req-cffc06e0-a56b-4d0d-a69f-d3dcfb99420a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.2067094
May 26 15:00:05.193400 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da16f4df-f831-404b-a26e-7a6d8124e71a req-21afce5e-c261-4e13-b9b4-aadd17e1201a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 944 time: 0.2803264
May 26 15:00:05.207223 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 717c230d-741b-4c4f-abf3-9fd63dc119c4 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:05.215363 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 717c230d-741b-4c4f-abf3-9fd63dc119c4 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:05.216091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.224227 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.274474 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da16f4df-f831-404b-a26e-7a6d8124e71a req-5e2d2b57-b178-46e1-9494-719a8332a106 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0693717
May 26 15:00:05.311517 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.321190 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:05.327392 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-90225932-269f-4052-a695-194031d20871 req-9db641f7-c775-47a9-bf75-bf69e146727f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1397471
May 26 15:00:05.364055 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1226}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 15:00:05.407171 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.407581 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Added segment e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b of type vlan for network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3
May 26 15:00:05.416395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb3c3ed7-c943-4a76-b35f-84b2db22a6a5,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:05.420794 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:05.503835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.514933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Attempting to bind port 093539a9-fe4c-473b-afed-760a8fa8122e on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:05.515308 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Attempting to bind port 093539a9-fe4c-473b-afed-760a8fa8122e by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:05.515677 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Attempting to bind port 093539a9-fe4c-473b-afed-760a8fa8122e on network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:05.525704 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:05.526049 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Checking segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:05.526640 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.527039 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Bound using segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:05.527552 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Bound port: 093539a9-fe4c-473b-afed-760a8fa8122e, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:05.527928 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.617585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c31d4c-7fe2-4729-9930-937346263be7 req-67616af1-904b-459d-94f4-d903074cd7bd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:05.626061 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-52c31d4c-7fe2-4729-9930-937346263be7 req-67616af1-904b-459d-94f4-d903074cd7bd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1704054
May 26 15:00:05.630345 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 req-7b08acfd-011a-4dd9-a624-08d093aa5c96 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:05.637989 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 req-7b08acfd-011a-4dd9-a624-08d093aa5c96 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1155164
May 26 15:00:05.680914 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-52c31d4c-7fe2-4729-9930-937346263be7 req-78acac4c-9ac9-401a-908b-f624ca53d67c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535154
May 26 15:00:05.686004 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] For port 093539a9-fe4c-473b-afed-760a8fa8122e, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:05.686004 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] For port 093539a9-fe4c-473b-afed-760a8fa8122e, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=093539a9-fe4c-473b-afed-760a8fa8122e,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:05.686954 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.688636 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:05.688933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.689671 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.696949 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:05.714439 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 req-77ffb447-ea96-4d3f-9f79-3bc11c2df546 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0748327
May 26 15:00:05.719635 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:05.736505 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:05.791354 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.795599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:05.836989 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4', 'code': 200}
May 26 15:00:05.841456 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Pushing event updated for resources: {'Network': ['ID=93bb6fb9-a4aa-410c-ad6f-f2197fd69da3,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:05.845691 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:05.848837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:05.862581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 15:00:05.870328 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 883 time: 1.1718979
May 26 15:00:05.873299 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58394) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:05.879919 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Request body: {'subnet': {'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1907873096-subnet', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'ip_version': 4}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:05.888340 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:05.897009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Usage tracker for resource:subnet and tenant:e45a0526c7fe43899d670e392bac47de is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:05.905125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:05.913483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:06.022397 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:06.024120 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabffdcb80>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:06.038917 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Made reservation on behalf of e45a0526c7fe43899d670e392bac47de for: {'subnet': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:00:06.041215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2161934'] for subnet, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:06.145463 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Pushing event updated for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:06.164476 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.369s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:06.165110 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.305s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:06.250694 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 req-b0cbfd3a-3526-4d70-ac75-cad2043e4f04 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:06.258417 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 req-b0cbfd3a-3526-4d70-ac75-cad2043e4f04 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2865818
May 26 15:00:06.349567 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:06.373733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:06.389691 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:06.430692 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 req-401e04fe-de60-4aeb-9f92-32ba825da3dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1713352
May 26 15:00:06.667961 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8573768a-584e-4601-88e0-2547c2bea45a req-49118217-97d1-4b19-861e-663e615ee603 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:06.671323 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8573768a-584e-4601-88e0-2547c2bea45a req-49118217-97d1-4b19-861e-663e615ee603 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1517529
May 26 15:00:06.766348 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8573768a-584e-4601-88e0-2547c2bea45a req-6b19f2e3-e45e-4af9-97f9-10fafbf8ddc2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0830181
May 26 15:00:06.781150 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56788f80-432e-4006-9fc6-60a711c24768 req-b0fd881b-24ab-41d2-939e-46064b6e06ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:06.781150 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-56788f80-432e-4006-9fc6-60a711c24768 req-b0fd881b-24ab-41d2-939e-46064b6e06ee service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 1098 time: 0.4517527
May 26 15:00:06.849406 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-56788f80-432e-4006-9fc6-60a711c24768 req-e049b087-08d3-407f-8196-2afed225e73f service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488989
May 26 15:00:06.932147 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6d3c687-9a4f-4412-89c4-59563e84fb0a req-2da3d080-0a2b-468f-8060-5c849795a125 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:06.940025 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6d3c687-9a4f-4412-89c4-59563e84fb0a req-2da3d080-0a2b-468f-8060-5c849795a125 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.2273331
May 26 15:00:06.946595 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabffdcb80>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:05Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:06.951809 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2094810d-0f5b-43f7-a927-6f2e9f990f9e None None] The sync data for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi is: [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:05Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:00:07.037576 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6d3c687-9a4f-4412-89c4-59563e84fb0a req-47f808c7-fd0e-4d0f-9076-72f028c4c2a7 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0822287
May 26 15:00:07.045569 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 req-312ed947-1fd5-4f63-ba33-bac6d14ad4b5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:07.066300 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 req-312ed947-1fd5-4f63-ba33-bac6d14ad4b5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1840193
May 26 15:00:07.177198 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 req-2d91f26a-1b00-4187-af59-c2224aafb96d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1096992
May 26 15:00:07.374696 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 req-a6e9541a-10db-44ec-8c88-dfcf742d0711 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:07.389023 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 req-a6e9541a-10db-44ec-8c88-dfcf742d0711 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1489575
May 26 15:00:07.457745 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 req-03ff17e9-fe97-4caa-b943-5643ab952b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680497
May 26 15:00:07.541945 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2226144', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2161944'] for subnet, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:07.546104 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-82b1d7e6-2c31-489a-97e8-10ea9aadd43d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:07.699587 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:07.706730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:07.898392 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d req-8f610d1b-4786-45e0-a344-a7b10df9249d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:07.916803 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d req-8f610d1b-4786-45e0-a344-a7b10df9249d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1485288
May 26 15:00:07.945998 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Checking segment: {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:07.964070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Network hostable DHCP agents. Network: 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103981) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 15:00:07.976833 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 req-5316aa02-4351-47c8-8b09-9e50214f9153 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:07.983517 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d req-91dce371-7e94-47f8-9253-d77de6fcbe54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0605078
May 26 15:00:07.985416 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 req-5316aa02-4351-47c8-8b09-9e50214f9153 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2903810
May 26 15:00:08.345911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 req-1dac3645-8fec-4069-89f5-b8d44202e7bc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.348225 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 req-1dac3645-8fec-4069-89f5-b8d44202e7bc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1289766
May 26 15:00:08.420408 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 req-f3f647be-4a47-4616-955e-ea11dffac888 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.4324603
May 26 15:00:08.431124 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 req-1674f767-e112-41d8-83a2-03933af35003 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0767381
May 26 15:00:08.460921 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-a4dfc4b3-20f6-4464-ae03-a8deea548346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.463136 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-a4dfc4b3-20f6-4464-ae03-a8deea548346 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1098 time: 0.4678311
May 26 15:00:08.463136 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103981) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 15:00:08.580158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3) {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:08.593322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8cd1436a-b1ff-43d1-b7e8-742484475500 None None] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:00:08.612674 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.613347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:08.703480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-f3a91f6b-fc50-4881-9216-441ba02974f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.706417 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-f3a91f6b-fc50-4881-9216-441ba02974f8 service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.2327595
May 26 15:00:08.708452 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13ccbde2-5e10-428c-b2b6-089691d4402e req-d947a88d-107f-4d3a-8504-d05bae6ee8c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.710146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-13ccbde2-5e10-428c-b2b6-089691d4402e req-d947a88d-107f-4d3a-8504-d05bae6ee8c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0997641
May 26 15:00:08.797436 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-13ccbde2-5e10-428c-b2b6-089691d4402e req-aa6953b5-c0c9-40fa-b29d-6007d71f1afd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0773497
May 26 15:00:08.885491 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-6d1d21e8-fc9b-40c0-aca7-f144f0475036 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 1000 time: 0.1650486
May 26 15:00:08.889522 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3ddbbd83-44fe-42ff-9217-71475dd0b676 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 3.0125892
May 26 15:00:08.889827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58428) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:08.895760 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:08.996490 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-cf1b3126-54e7-4264-8918-dbca318652a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:08.996490 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-cf1b3126-54e7-4264-8918-dbca318652a5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.0802107
May 26 15:00:08.997315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:09.076187 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 093539a9-fe4c-473b-afed-760a8fa8122e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:09.080370 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Usage tracker for resource:router and tenant:e45a0526c7fe43899d670e392bac47de is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:09.088220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:09.103148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:09.127077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'fixed_ips': [{'subnet_id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 15:00:09.128545 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.142445 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-2ecb57f3-1ab3-42d2-83b5-0c92782e5ba2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:09.144015 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-2ecb57f3-1ab3-42d2-83b5-0c92782e5ba2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1347001
May 26 15:00:09.322408 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-67cd8189-049e-4b4d-b7fa-efd23dd409e9 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1671653
May 26 15:00:09.327330 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.328630 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.342887 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Allocated IP 172.20.0.2 (93bb6fb9-a4aa-410c-ad6f-f2197fd69da3/c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9/a883160d-7880-408a-8d86-7c33acef58b5) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:09.397617 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 093539a9-fe4c-473b-afed-760a8fa8122e completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:09.515166 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 093539a9-fe4c-473b-afed-760a8fa8122e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:09.515543 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.545423 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.591518 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 req-a99df480-661c-4f99-9ca5-915b7b80c322 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2571602
May 26 15:00:09.615200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0630f9-25a4-40ae-80f8-f10447892ff8 req-1912cd40-6502-48ea-a2f8-48544afe5cae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:09.617978 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa0630f9-25a4-40ae-80f8-f10447892ff8 req-1912cd40-6502-48ea-a2f8-48544afe5cae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2930560
May 26 15:00:09.757705 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa0630f9-25a4-40ae-80f8-f10447892ff8 req-c0a6f942-dcc2-4fa7-a245-5363f7280dcc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1344287
May 26 15:00:09.803190 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.846778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Transition to ACTIVE for port object a883160d-7880-408a-8d86-7c33acef58b5 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:09.846778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Transition to ACTIVE for port object a883160d-7880-408a-8d86-7c33acef58b5 will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:09.879464 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:09.939940 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 093539a9-fe4c-473b-afed-760a8fa8122e, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=093539a9-fe4c-473b-afed-760a8fa8122e,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:10.091315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.142585 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab req-93e136fe-fa04-4b8a-83a1-94d8365abddc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:10.144595 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab req-93e136fe-fa04-4b8a-83a1-94d8365abddc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1865840
May 26 15:00:10.195372 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab req-b96bca0a-97db-4cdb-847e-62fafe9ed350 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449598
May 26 15:00:10.293921 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.303853 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:10.364501 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:10.367351 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:10.371042 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:10.410601 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Pushing event updated for resources: {'Port': ['ID=a883160d-7880-408a-8d86-7c33acef58b5,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:10.410923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29a60201-b851-4720-b22f-fa077c6f865c req-61cf1d08-1a6d-4146-a1e6-8cf295416ea9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:10.413260 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-29a60201-b851-4720-b22f-fa077c6f865c req-61cf1d08-1a6d-4146-a1e6-8cf295416ea9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1127396
May 26 15:00:10.425320 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:10.459688 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.466451 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:10.483069 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-29a60201-b851-4720-b22f-fa077c6f865c req-e7f2e4b2-4aff-43d0-8182-9e7a2938e3e5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0644989
May 26 15:00:10.571954 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Attempting to bind port a883160d-7880-408a-8d86-7c33acef58b5 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:10.572581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Attempting to bind port a883160d-7880-408a-8d86-7c33acef58b5 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:10.573014 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Attempting to bind port a883160d-7880-408a-8d86-7c33acef58b5 on network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:10.589107 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:10.591128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Checking segment: {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:10.591128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.591128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Bound using segment: {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:10.591462 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Bound port: a883160d-7880-408a-8d86-7c33acef58b5, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:10.591999 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.614304 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:10.619820 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:10.711683 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] For port a883160d-7880-408a-8d86-7c33acef58b5, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:10.715441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] For port a883160d-7880-408a-8d86-7c33acef58b5, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a883160d-7880-408a-8d86-7c33acef58b5,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:10.842034 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:10.847217 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:10.934361 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Pushing event updated for resources: {'Port': ['ID=a883160d-7880-408a-8d86-7c33acef58b5,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:10.941873 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:10.999765 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 req-01272acc-fb9c-489c-9e18-68090f5bcafa tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:11.002414 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 req-01272acc-fb9c-489c-9e18-68090f5bcafa tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2771668
May 26 15:00:11.070808 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 093539a9-fe4c-473b-afed-760a8fa8122e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:11.084698 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:11.171818 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 req-7514b722-811e-45f1-b097-ff90d60962fb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1519504
May 26 15:00:11.179439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:11.220754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 093539a9-fe4c-473b-afed-760a8fa8122e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:11.220754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:11.369869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea req-6a59a8ad-080f-427e-b3a6-60972c2beb04 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:11.373932 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea req-6a59a8ad-080f-427e-b3a6-60972c2beb04 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2341509
May 26 15:00:11.480277 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea req-306d412f-b2d3-48d1-b15f-8820a09f798f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0955710
May 26 15:00:11.567159 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Allocated IP 172.27.2.93 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/a54b16fc-2508-4b0e-909e-8d12d563ccaa) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:11.791046 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 req-c742ee41-0a6b-41af-9653-c525bf5d31f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:11.792365 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 req-c742ee41-0a6b-41af-9653-c525bf5d31f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1363356
May 26 15:00:11.885462 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:11.904557 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 req-b7048e99-d278-4220-9ab4-5ce9ba24a73b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1053758
May 26 15:00:12.030876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:12.036483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-571cca0e-2944-4876-b48e-1f4421409c3d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:12.123157 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:12.133728 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:12.142085 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:12.190913 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Pushing event updated for resources: {'Port': ['ID=a54b16fc-2508-4b0e-909e-8d12d563ccaa,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:12.308393 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:12.449693 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-719b22ea-2813-4320-ac7a-dfe6db5fa2a3 None None] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:00:12.592656 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0031368-6bda-4554-b837-d9d3aee94cef req-ad8fd16d-c3c5-4886-a999-96f842996c81 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:12.600745 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b0031368-6bda-4554-b837-d9d3aee94cef req-ad8fd16d-c3c5-4886-a999-96f842996c81 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1963086
May 26 15:00:12.672991 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b0031368-6bda-4554-b837-d9d3aee94cef req-45e33365-7404-49a7-9009-1bb393388293 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0636301
May 26 15:00:12.703098 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7030578c-2cff-451e-b0c6-bcdf28ef5e85 None None] Provisioning for port a883160d-7880-408a-8d86-7c33acef58b5 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:12.898358 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb req-906e810f-dbaf-49ec-95ad-7a8d0f66ffb0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:12.906386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb req-906e810f-dbaf-49ec-95ad-7a8d0f66ffb0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1575630
May 26 15:00:12.928777 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.028023 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb req-85bc06cd-b751-4fec-82c7-b8bffebecefc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1204717
May 26 15:00:13.132477 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a883160d-7880-408a-8d86-7c33acef58b5 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:13.328308 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port a883160d-7880-408a-8d86-7c33acef58b5 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:13.334215 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port a883160d-7880-408a-8d86-7c33acef58b5 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:13.334728 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.444883 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948bd759-6a9a-4a1e-8847-cc649dccc6ba req-98851da5-639d-4d31-a0dc-a9c5057e66c8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:13.446605 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-948bd759-6a9a-4a1e-8847-cc649dccc6ba req-98851da5-639d-4d31-a0dc-a9c5057e66c8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.2218678
May 26 15:00:13.596478 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-73686eaf-8865-4a17-bcbf-15d449d09226 None None] Provisioning complete for port a883160d-7880-408a-8d86-7c33acef58b5 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:13.597035 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-73686eaf-8865-4a17-bcbf-15d449d09226 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.646236 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.711320 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-948bd759-6a9a-4a1e-8847-cc649dccc6ba req-54379716-8a34-4ff9-9ff0-9430408f8a72 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1748118
May 26 15:00:13.745633 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.749597 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port a883160d-7880-408a-8d86-7c33acef58b5, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a883160d-7880-408a-8d86-7c33acef58b5,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:13.783283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-73686eaf-8865-4a17-bcbf-15d449d09226 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.820632 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:13.823113 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:13.934343 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=a883160d-7880-408a-8d86-7c33acef58b5,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:13.942714 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:13.978768 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.db.api [None req-73686eaf-8865-4a17-bcbf-15d449d09226 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=103983) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 26 15:00:13.979377 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_db.api [None req-73686eaf-8865-4a17-bcbf-15d449d09226 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 26 15:00:14.041585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a req-0053e0b1-49cc-4217-a000-d744eddac297 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:14.045847 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a req-0053e0b1-49cc-4217-a000-d744eddac297 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2028139
May 26 15:00:14.112975 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a req-6440754f-01fa-4957-895d-d72c1e4ee4b2 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0569730
May 26 15:00:14.119492 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Router 9c922391-3664-47fa-841b-f46221e134d0 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103981) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 15:00:14.380280 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:00:14.393215 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Sync routers for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:00:14.396065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7d9480-dda2-4569-926b-02c5cb1408b0 req-c8327a97-6fb6-4cc1-a960-6240f60cbf1c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:14.397619 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cc7d9480-dda2-4569-926b-02c5cb1408b0 req-c8327a97-6fb6-4cc1-a960-6240f60cbf1c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.2001874
May 26 15:00:14.411454 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:14.412084 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4df3cd0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:14.466203 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cc7d9480-dda2-4569-926b-02c5cb1408b0 req-55aa7489-303d-4213-a077-d7a23f56ca2a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600085
May 26 15:00:14.511224 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:14.512528 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 920 time: 5.6217170
May 26 15:00:14.516917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58498) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:14.641176 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:14.975716 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4df3cd0>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:12Z', 'revision_number': 3, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:14.980064 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Checking router: 9c922391-3664-47fa-841b-f46221e134d0 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:00:14.980419 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Updating router 9c922391-3664-47fa-841b-f46221e134d0 port a54b16fc-2508-4b0e-909e-8d12d563ccaa binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:00:15.012604 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a883160d-7880-408a-8d86-7c33acef58b5 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:15.082388 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:15.149557 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port a883160d-7880-408a-8d86-7c33acef58b5 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:15.149954 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:15.368197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 req-644046c3-4480-4072-b9ab-7026af9c5095 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:15.369843 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 req-644046c3-4480-4072-b9ab-7026af9c5095 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.4096284
May 26 15:00:15.506759 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 req-f170fea4-2873-4e0e-9dc2-0824efd53c1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0704532
May 26 15:00:15.508850 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:15.517943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:15.526533 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Transition to ACTIVE for port object a54b16fc-2508-4b0e-909e-8d12d563ccaa will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:15.567731 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 req-8aec55a6-cc1c-4fa7-aaaf-c4681b129398 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:15.569517 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 req-8aec55a6-cc1c-4fa7-aaaf-c4681b129398 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1121166
May 26 15:00:15.620768 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 req-495522fd-e6b1-47a4-8bc7-a3cd33de5dd1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440342
May 26 15:00:15.855476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5e983e-2d0b-434f-a751-c7157adceac9 req-404edee0-1862-4c50-b643-f47a6b0b98b2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:15.856926 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bc5e983e-2d0b-434f-a751-c7157adceac9 req-404edee0-1862-4c50-b643-f47a6b0b98b2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1924615
May 26 15:00:15.866651 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Allocated IP 172.20.0.1 (93bb6fb9-a4aa-410c-ad6f-f2197fd69da3/c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9/df9a0739-5987-4fbd-945a-00feffe90d14) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:15.979217 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bc5e983e-2d0b-434f-a751-c7157adceac9 req-6be97c9e-4bdd-4167-b3ba-80991e9ee151 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1143031
May 26 15:00:16.006795 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.011699 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:16.061301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.087735 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Transition to ACTIVE for port object df9a0739-5987-4fbd-945a-00feffe90d14 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:16.112016 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Attempting to bind port a54b16fc-2508-4b0e-909e-8d12d563ccaa on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:16.112394 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Attempting to bind port a54b16fc-2508-4b0e-909e-8d12d563ccaa by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:16.112759 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Attempting to bind port a54b16fc-2508-4b0e-909e-8d12d563ccaa on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:16.119069 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aefa64f3-7441-4ccb-b5cd-cd14a9c44904 None None] Pushing event updated for resources: {'Port': ['ID=a54b16fc-2508-4b0e-909e-8d12d563ccaa,revision_number=2']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:16.128526 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-aefa64f3-7441-4ccb-b5cd-cd14a9c44904 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:16.129574 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:16.129965 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:16.130337 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.132396 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:16.132396 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Bound port: a54b16fc-2508-4b0e-909e-8d12d563ccaa, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:16.132396 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.197278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.213233 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:16.233493 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] For port a54b16fc-2508-4b0e-909e-8d12d563ccaa, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:16.237221 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] For port a54b16fc-2508-4b0e-909e-8d12d563ccaa, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a54b16fc-2508-4b0e-909e-8d12d563ccaa,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:16.270724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:16.278735 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:16.281244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:16.334792 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.341409 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:16.465639 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aefa64f3-7441-4ccb-b5cd-cd14a9c44904 None None] Pushing event updated for resources: {'Port': ['ID=a54b16fc-2508-4b0e-909e-8d12d563ccaa,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:16.468678 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Pushing event updated for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:16.471474 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-aefa64f3-7441-4ccb-b5cd-cd14a9c44904 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:16.488862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:16.497453 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.501624 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:16.502557 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4df3cd0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:16.762922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058650a8-aa02-4736-9170-d15776df15de req-ae06d170-ee33-4b08-a4a7-6f3a41bab3e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:16.764804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.769648 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-058650a8-aa02-4736-9170-d15776df15de req-ae06d170-ee33-4b08-a4a7-6f3a41bab3e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1101513
May 26 15:00:16.784967 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-244fe7fd-c83e-41e2-b285-1fcf4814a35f None None] Provisioning for port df9a0739-5987-4fbd-945a-00feffe90d14 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:16.791548 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-244fe7fd-c83e-41e2-b285-1fcf4814a35f None None] Provisioning complete for port df9a0739-5987-4fbd-945a-00feffe90d14 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:16.791928 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-244fe7fd-c83e-41e2-b285-1fcf4814a35f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:16.827399 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-058650a8-aa02-4736-9170-d15776df15de req-1c996d3c-0d03-44fe-9569-42a64a1bc9a5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0484514
May 26 15:00:16.893186 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-244fe7fd-c83e-41e2-b285-1fcf4814a35f None None] Port df9a0739-5987-4fbd-945a-00feffe90d14 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:00:16.922652 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:17.006224 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e req-b9bbc106-4419-4855-9cd6-ee6806e8515f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:17.007624 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e req-b9bbc106-4419-4855-9cd6-ee6806e8515f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2307308
May 26 15:00:17.131869 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e req-03572d15-7faf-4d64-901a-6bdae2bbe76b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045887
May 26 15:00:17.187916 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 req-6eaed9f0-cb2d-4685-9fe3-f4510c8ee2a4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:17.190221 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 req-6eaed9f0-cb2d-4685-9fe3-f4510c8ee2a4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.0986035
May 26 15:00:17.209970 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:17.245622 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4df3cd0>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:12Z', 'revision_number': 3, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:17.248236 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 req-fbcdd79c-e0ac-4d71-933f-972bee20f363 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479677
May 26 15:00:17.249925 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b02a9713-bdc9-4f23-928d-772610d5f1b5 None None] The sync data for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi is: [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:12Z', 'revision_number': 3, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:00:17.275831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:17.303326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:17.391370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Pushing event updated for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:17.394592 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:17.397776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:17.568477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:17.569808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:17.768204 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Router 9c922391-3664-47fa-841b-f46221e134d0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:00:17.836213 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-b048a549-349c-44fe-a61e-3270435ff3e2 None None] Provisioning complete for port df9a0739-5987-4fbd-945a-00feffe90d14 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:17.836759 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b048a549-349c-44fe-a61e-3270435ff3e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:17.896588 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-b048a549-349c-44fe-a61e-3270435ff3e2 None None] Port df9a0739-5987-4fbd-945a-00feffe90d14 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:00:18.036392 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:00:18.057601 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] 10.222.0.81 "PUT /v2.0/routers/9c922391-3664-47fa-841b-f46221e134d0/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.5343463
May 26 15:00:18.080793 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3967d0f-0b47-4506-8fb9-17e189699c5d req-846cf5a9-fbfe-4a4a-9b60-41d54bd35267 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.082319 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3967d0f-0b47-4506-8fb9-17e189699c5d req-846cf5a9-fbfe-4a4a-9b60-41d54bd35267 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1153920
May 26 15:00:18.148443 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3967d0f-0b47-4506-8fb9-17e189699c5d req-677e7e7b-cd1b-4698-bf09-e6f8be078ce1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0602715
May 26 15:00:18.389739 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78958054-db4b-405b-a86e-fa483b77d70d req-55b3118a-938c-41de-9b7c-520ababedd50 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.391170 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-78958054-db4b-405b-a86e-fa483b77d70d req-55b3118a-938c-41de-9b7c-520ababedd50 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.1420951
May 26 15:00:18.402095 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 req-c364a615-3e6a-47f3-b52d-2b200730bdbc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.403502 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 req-c364a615-3e6a-47f3-b52d-2b200730bdbc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1174419
May 26 15:00:18.520556 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-cc65a892-be8c-46eb-9297-9cf835ba1e53 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.522289 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-cc65a892-be8c-46eb-9297-9cf835ba1e53 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1099 time: 0.0792346
May 26 15:00:18.543429 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 req-97f98703-0b41-475c-8ca9-bebf618bdd3d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1039462
May 26 15:00:18.594233 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Deleting port 717c230d-741b-4c4f-abf3-9fd63dc119c4 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:00:18.594725 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:18.711103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-a145368f-0c8a-47f2-b8db-67a838ade5d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.712572 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-a145368f-0c8a-47f2-b8db-67a838ade5d4 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.1819155
May 26 15:00:18.906994 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-df17b3b7-fd4a-42ab-a897-e4cb6eef5bd5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 1001 time: 0.1868269
May 26 15:00:18.909156 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] For port 717c230d-741b-4c4f-abf3-9fd63dc119c4, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=717c230d-741b-4c4f-abf3-9fd63dc119c4,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:18.909655 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:18.930978 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2a7216-857e-414d-854b-ec66d73e9b09 req-5fa44b46-699b-4049-973e-c6e309ed7156 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:18.938423 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3e2a7216-857e-414d-854b-ec66d73e9b09 req-5fa44b46-699b-4049-973e-c6e309ed7156 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 945 time: 0.2196403
May 26 15:00:18.964971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58562) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:18.973704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1398860261', 'description': 'tempest-secgroup-smoke-1398860261 description', 'project_id': '07c65d1e254f424ebfea8360aa697c34'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:18.991576 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:18.998483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:19.004735 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:19.015201 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:19.019748 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-cfac5b59-3d5e-4ffe-9abe-198b72d1a860 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:19.020528 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-cfac5b59-3d5e-4ffe-9abe-198b72d1a860 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.1028395
May 26 15:00:19.088713 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a54b16fc-2508-4b0e-909e-8d12d563ccaa up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:19.089229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling delete_port for 717c230d-741b-4c4f-abf3-9fd63dc119c4 owned by compute:nova {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:00:19.106962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.120708 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Sync routers for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:00:19.128665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:19.134556 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:19.138309 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:19.146130 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:19.150587 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:19.151683 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41904f0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:19.160746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-95929744-d4e5-4daf-b40b-d99e09f133e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:19.162386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-95929744-d4e5-4daf-b40b-d99e09f133e4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1256804
May 26 15:00:19.322101 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3e2a7216-857e-414d-854b-ec66d73e9b09 req-bfc7edf7-3cbe-4ca9-a11c-a751caa7ae65 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3826985
May 26 15:00:19.382996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:19.401988 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.410192 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:19.430250 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['717c230d-741b-4c4f-abf3-9fd63dc119c4'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:00:19.465707 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-911ad14d-7aba-4975-ab44-25ee3a95b9c7 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2768235
May 26 15:00:19.469140 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Pushing event deleted for resources: {'Port': ['ID=717c230d-741b-4c4f-abf3-9fd63dc119c4,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:19.478489 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:19.492808 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port a54b16fc-2508-4b0e-909e-8d12d563ccaa completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:19.504916 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port a54b16fc-2508-4b0e-909e-8d12d563ccaa triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:19.505298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.530819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.573756 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] No DVR routers for this DVR port 717c230d-741b-4c4f-abf3-9fd63dc119c4 on host hv-cinder-78414 {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:00:19.578222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.583563 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'name': 'network-vif-deleted', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:19.621728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.642165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ec161593-aac1-4e12-844e-a8819dc28a79 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:19.688966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 req-655152ac-1ed0-4bba-b6be-b2c78beaf80a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:19.690743 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 req-655152ac-1ed0-4bba-b6be-b2c78beaf80a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.3669031
May 26 15:00:19.729449 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-78958054-db4b-405b-a86e-fa483b77d70d req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "DELETE /v2.0/ports/717c230d-741b-4c4f-abf3-9fd63dc119c4 HTTP/1.1" status: 204  len: 173 time: 1.3233869
May 26 15:00:19.739875 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e529f520-2545-4975-afd4-3361721fae1d,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:19.746992 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:19.774196 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8daaf018-5bf2-4e89-b268-99330b5a2b14 req-3ed9770c-bf75-424f-a6cd-859ebfd373a8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:19.776302 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8daaf018-5bf2-4e89-b268-99330b5a2b14 req-3ed9770c-bf75-424f-a6cd-859ebfd373a8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1076393
May 26 15:00:19.782663 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.783901 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.8177397
May 26 15:00:19.786091 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c8620aa-6b70-405c-9c65-a19a0fa62106 req-90f34422-4e83-4734-8088-0718298b10fa service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3016033
May 26 15:00:19.787777 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58576) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:19.790969 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 req-469e0685-5b0f-4331-b8c0-d56ca81ecd29 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0880842
May 26 15:00:19.808583 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:19.814197 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:19.820875 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:19.831492 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:19.835560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:19.853696 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:19.871414 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port a54b16fc-2508-4b0e-909e-8d12d563ccaa, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a54b16fc-2508-4b0e-909e-8d12d563ccaa,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:19.871844 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8daaf018-5bf2-4e89-b268-99330b5a2b14 req-3187a299-bf63-4712-ac48-3171c0f901a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0888152
May 26 15:00:19.874334 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '017ce180-3d28-4cea-8c40-c113c3627273', 'name': 'network-vif-deleted', 'tag': '717c230d-741b-4c4f-abf3-9fd63dc119c4', 'status': 'completed', 'code': 200}
May 26 15:00:19.895282 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41904f0>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 4, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'df9a0739-5987-4fbd-945a-00feffe90d14', 'name': '', 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'mac_address': 'fa:16:3e:a4:03:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 383, 'fixed_ips': [{'subnet_id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:15Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 2, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'subnets': [{'id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:19.899181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Checking router: 9c922391-3664-47fa-841b-f46221e134d0 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:00:19.899533 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Updating router 9c922391-3664-47fa-841b-f46221e134d0 port df9a0739-5987-4fbd-945a-00feffe90d14 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:00:19.952975 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.002750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.031933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.039339 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:20.070480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.133319 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.136717 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:20.155257 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4cac109a-d54a-41fe-a5fd-a35f374d8ec2,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:20.162098 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:20.175741 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=a54b16fc-2508-4b0e-909e-8d12d563ccaa,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:20.181435 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:20.236947 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.241203 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.4491963
May 26 15:00:20.241494 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58582) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:20.246879 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:20.253655 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:20.257485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:20.260413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:20.269403 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:20.365855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.410897 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.442710 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Transition to ACTIVE for port object df9a0739-5987-4fbd-945a-00feffe90d14 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:20.466177 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.519210 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1761355e-23b8-41dd-9c6e-afa8273c7a03 req-3006bcff-54fc-4ac1-bced-aecbff521585 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0450776
May 26 15:00:20.537849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.540333 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:20.562070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.570193 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:20.583184 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-92585329-bcfa-4348-8ba8-c1bf135bc155 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.590326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50e0f528-2dd8-485c-9341-3de7e2805734,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:20.601037 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:20.670791 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.676088 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4311275
May 26 15:00:20.676558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58596) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:20.683338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:20.691319 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:20.696337 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:20.700493 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:20.708862 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Pushing event updated for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:20.709807 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:20.742540 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:20.764151 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Attempting to bind port df9a0739-5987-4fbd-945a-00feffe90d14 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:20.764455 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Attempting to bind port df9a0739-5987-4fbd-945a-00feffe90d14 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:20.764863 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Attempting to bind port df9a0739-5987-4fbd-945a-00feffe90d14 on network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:20.771329 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 14, 59, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:20.771711 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Checking segment: {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:20.772113 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.772510 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Bound using segment: {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:20.772987 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Bound port: df9a0739-5987-4fbd-945a-00feffe90d14, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:20.773366 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.824819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.878015 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] For port df9a0739-5987-4fbd-945a-00feffe90d14, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:20.881659 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] For port df9a0739-5987-4fbd-945a-00feffe90d14, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=df9a0739-5987-4fbd-945a-00feffe90d14,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:20.934434 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.974158 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:20.978245 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:21.002777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.005511 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:21.018751 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a54b16fc-2508-4b0e-909e-8d12d563ccaa up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:21.030625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cb558a29-b43d-4d21-a3e7-3c2fef7f50ca,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:21.038718 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:21.056505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e655c8-bc64-4d72-932b-29d765db4769 req-cadecdf6-c6e9-4aac-9d7b-0ef9311fb1db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:21.057284 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-22e655c8-bc64-4d72-932b-29d765db4769 req-cadecdf6-c6e9-4aac-9d7b-0ef9311fb1db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1085525
May 26 15:00:21.108929 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-22e655c8-bc64-4d72-932b-29d765db4769 req-7b8f70fe-f2b3-45ff-b501-3a68496c4dc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445051
May 26 15:00:21.124046 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:00:21.124684 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41904f0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T14:59:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:21.156259 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.157902 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4800935
May 26 15:00:21.160489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58610) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:21.173724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:21.179611 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:21.182791 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Pushing event updated for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:21.187317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:21.195008 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:21.197949 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.219s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:21.205659 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:21.232474 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port a54b16fc-2508-4b0e-909e-8d12d563ccaa triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:21.232857 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.287513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.350647 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 req-4f86a00c-7f6e-498c-a875-d8470e2c55e6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:21.352371 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 req-4f86a00c-7f6e-498c-a875-d8470e2c55e6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1026664
May 26 15:00:21.393681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.410575 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 req-c380690f-72f9-45ad-ad48-c17070eb66c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0524285
May 26 15:00:21.422455 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:00:21.458785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.460744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:21.482946 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=92baf603-497e-4502-9337-bb6785f56bd3,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:21.485526 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:21.556250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.560026 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3957613
May 26 15:00:21.561598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58618) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:21.573585 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:21.590632 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:21.599446 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:21.602626 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:21.608981 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:21.693458 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.securitygroups_db [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Project 07c65d1e254f424ebfea8360aa697c34 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:00:21.699395 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.711318 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73b0cdcf-d298-48c4-a66a-70485aceb300 req-1cd080f2-a20c-49e7-aca7-b2bfe2e871f9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.0468719
May 26 15:00:21.767613 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.825798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41904f0>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 4, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'df9a0739-5987-4fbd-945a-00feffe90d14', 'name': '', 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'mac_address': 'fa:16:3e:a4:03:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 383, 'fixed_ips': [{'subnet_id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:15Z', 'updated_at': '2021-05-26T15:00:20Z', 'revision_number': 4, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'subnets': [{'id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:00:21.829765 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd422a7d-d7af-4fba-85b8-60e0fb19dbe5 None None] The sync data for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi is: [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:00:16Z', 'revision_number': 4, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'df9a0739-5987-4fbd-945a-00feffe90d14', 'name': '', 'network_id': '93bb6fb9-a4aa-410c-ad6f-f2197fd69da3', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'mac_address': 'fa:16:3e:a4:03:d4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_interface', 'standard_attr_id': 383, 'fixed_ips': [{'subnet_id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:15Z', 'updated_at': '2021-05-26T15:00:20Z', 'revision_number': 4, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'subnets': [{'id': 'c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:00:21.836106 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.838296 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:21.864575 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c6272bc0-1a43-42bc-bb0a-fc92acfd1336,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:21.874748 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:21.967717 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:21.968871 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.4073765
May 26 15:00:21.972104 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 58624) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:21.977712 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'security_group_rule': {'security_group_id': 'e529f520-2545-4975-afd4-3361721fae1d', 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:21.984121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:21.988880 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:security_group_rule and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:21.991956 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:21.998131 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:22.070714 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.securitygroups_db [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Project 07c65d1e254f424ebfea8360aa697c34 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:00:22.076955 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:22.161983 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:22.242171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:22.244308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d90e51e-b622-4dbd-a43b-829613fb0a39 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:22.271102 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=40a75dca-415e-460e-9fb4-eed188a9f5e3,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:22.281419 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:22.340559 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:22.350212 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3686953
May 26 15:00:22.479223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 req-90903d93-f363-4b5b-b730-30050a034503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:22.481679 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 req-90903d93-f363-4b5b-b730-30050a034503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.1064196
May 26 15:00:22.582648 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 req-0d09a4f4-06a0-431c-ba16-a8590c9cd3f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0903118
May 26 15:00:22.691311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b44616ac-09f2-4956-93dd-75e9f3b22520 req-ae7aa014-0788-461d-9baa-2fa0caa0b5fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:22.692855 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b44616ac-09f2-4956-93dd-75e9f3b22520 req-ae7aa014-0788-461d-9baa-2fa0caa0b5fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0856886
May 26 15:00:22.745910 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b44616ac-09f2-4956-93dd-75e9f3b22520 req-2d0c42bc-91a4-4d58-b61d-60373e79b537 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0459797
May 26 15:00:22.890983 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e52c6f75-050f-4bd6-a095-eb333b57345e req-0e14bb84-6e33-49c2-a421-2bea8ff29790 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:22.984764 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e52c6f75-050f-4bd6-a095-eb333b57345e req-0e14bb84-6e33-49c2-a421-2bea8ff29790 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:22.986028 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e52c6f75-050f-4bd6-a095-eb333b57345e req-0e14bb84-6e33-49c2-a421-2bea8ff29790 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=017ce180-3d28-4cea-8c40-c113c3627273 HTTP/1.1" status: 200  len: 210 time: 0.1478553
May 26 15:00:23.000090 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device df9a0739-5987-4fbd-945a-00feffe90d14 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:23.133124 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:23.161192 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4aa9beea-f454-4ba1-8eff-f81321839a08 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:23.164091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port df9a0739-5987-4fbd-945a-00feffe90d14 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:23.169121 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port df9a0739-5987-4fbd-945a-00feffe90d14 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:23.169504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:23.291443 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:23.328508 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port df9a0739-5987-4fbd-945a-00feffe90d14, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=df9a0739-5987-4fbd-945a-00feffe90d14,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:23.396354 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:23.398412 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:23.470030 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:23.473800 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:23.806403 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 req-69bf7ad5-96d2-43e2-8690-6fe9a67fd197 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:23.807894 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 req-69bf7ad5-96d2-43e2-8690-6fe9a67fd197 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 946 time: 0.0871656
May 26 15:00:23.857529 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 req-89c726e6-2e40-410c-ad1e-fd22273ca5be tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419688
May 26 15:00:23.956742 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67f42678-880b-4679-b681-1a52068aab65 req-686f114a-2ac1-48b8-95c8-2430af7edaa8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:23.958345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67f42678-880b-4679-b681-1a52068aab65 req-686f114a-2ac1-48b8-95c8-2430af7edaa8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0885856
May 26 15:00:24.026732 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67f42678-880b-4679-b681-1a52068aab65 req-fd144730-6c42-4d5b-a6d3-b121412893cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0522599
May 26 15:00:24.053783 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:24.067159 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:00:24.213298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:24.243787 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:24.254501 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:24.290572 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'code': 200}
May 26 15:00:24.321510 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:24.322326 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 717c230d-741b-4c4f-abf3-9fd63dc119c4 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:00:24.351662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:24.389068 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 717c230d-741b-4c4f-abf3-9fd63dc119c4 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:00:24.389414 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 717c230d-741b-4c4f-abf3-9fd63dc119c4 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:00:24.426441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=8']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:24.429947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:24.457277 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-ee05c503-6ea6-46c0-8c6e-b2aa68d550a3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:24.458778 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-ee05c503-6ea6-46c0-8c6e-b2aa68d550a3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/networks?id=85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 200  len: 809 time: 0.1491697
May 26 15:00:24.473665 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-ee20361a-774c-4ac2-baef-e28e22918fb3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/quotas/dffd269c3a344d36b77ebb04d0c412e3 HTTP/1.1" status: 200  len: 375 time: 0.0091684
May 26 15:00:24.604351 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-7872175b-ced6-4068-bedc-613c47241569 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1253612
May 26 15:00:24.756098 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-3a3b1a1c-8a83-43da-adfa-a131d12de097 service neutron] 10.222.0.81 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1430941
May 26 15:00:24.893206 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-d86318b8-1218-4912-ad78-bac3a5d94502 service neutron] 10.222.0.81 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1313815
May 26 15:00:25.004560 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device df9a0739-5987-4fbd-945a-00feffe90d14 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:25.074365 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port df9a0739-5987-4fbd-945a-00feffe90d14 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:25.075010 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:25.079526 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-472814be-3462-43e1-9f28-d67e6d7c2788 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:25.080980 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-472814be-3462-43e1-9f28-d67e6d7c2788 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.1704202
May 26 15:00:25.095963 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-130ca8bd-c899-427c-93ce-a1f1ccdb3c6b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/quotas/1515325707f64d58a28f26451b2c74de HTTP/1.1" status: 200  len: 375 time: 0.0094419
May 26 15:00:25.194622 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-440467fd-d69c-41b9-8e17-aa84264d365a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0932820
May 26 15:00:25.324570 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0f3384-216d-4650-8964-5337fdbc5476 req-473f2d89-d48d-4a32-a129-1af8f0731e1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:25.326309 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa0f3384-216d-4650-8964-5337fdbc5476 req-473f2d89-d48d-4a32-a129-1af8f0731e1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1096563
May 26 15:00:25.358826 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ea4b88f9-4670-46ea-9b95-74ec1acdc4d2 service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1568820
May 26 15:00:25.378740 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa0f3384-216d-4650-8964-5337fdbc5476 req-c54ec3a1-f364-4dba-98e5-2910350c113d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0452943
May 26 15:00:25.501238 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-bf473b51-3db8-4069-9f95-7901277e3eda service neutron] 10.222.0.81 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1363685
May 26 15:00:25.583366 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 req-05636aa0-0774-45b3-9d10-e75f4109b62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:25.585392 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:25.586003 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 req-05636aa0-0774-45b3-9d10-e75f4109b62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0980341
May 26 15:00:25.632624 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 req-0508c6b9-cef3-477f-a21e-010718fc380a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413868
May 26 15:00:25.727238 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6041af17-c06b-404c-bf6f-685269dfed85 req-7c863ba4-9873-4307-ac50-023e09ae55a8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0525177
May 26 15:00:25.802566 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b6f97f71-683e-4bb7-a870-6a79ece482cd req-bf5537cb-4cab-4c9b-a4be-2b9fc1335f35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 210 time: 0.0567467
May 26 15:00:26.576138 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76a34b0-081a-462f-bc83-07c1beee47fa req-aa0a69c7-a270-4039-a013-ce9406afe28c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:26.577614 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b76a34b0-081a-462f-bc83-07c1beee47fa req-aa0a69c7-a270-4039-a013-ce9406afe28c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0831697
May 26 15:00:26.622503 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b76a34b0-081a-462f-bc83-07c1beee47fa req-8ef8149d-46dd-4c08-9cba-07753faa0c59 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391772
May 26 15:00:26.874896 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 req-7aacc97d-c629-499c-be7f-8e01bb6dabfd tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0460258
May 26 15:00:26.906014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f req-234d870c-8fe0-4154-a21d-c65b1b674ac9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:26.908468 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f req-234d870c-8fe0-4154-a21d-c65b1b674ac9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1660213
May 26 15:00:26.955355 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f req-fcda6a11-7212-4a53-968a-6ca30a98e708 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393252
May 26 15:00:27.016005 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 req-8370a8f0-2d08-4093-8943-03a428ba8c62 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 210 time: 0.0451393
May 26 15:00:27.287591 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:00:27.635195 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:27.818682 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 req-629d88f2-e295-4855-86af-d3c405f4c464 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:27.820148 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 req-629d88f2-e295-4855-86af-d3c405f4c464 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0839608
May 26 15:00:27.865528 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 req-237d444b-b6ee-4fce-a207-d37f11d3b94d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397491
May 26 15:00:28.027597 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc req-c6114373-f211-4db8-be3c-90bd4a4755c0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0421903
May 26 15:00:28.145573 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 req-1af407bc-fc55-44a3-a2d9-d10dd8486313 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:28.147033 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 req-1af407bc-fc55-44a3-a2d9-d10dd8486313 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0824497
May 26 15:00:28.161592 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c req-df79eb81-39fd-496b-8128-37cddb641c67 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 210 time: 0.0421138
May 26 15:00:28.193490 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 req-baaef917-f202-4dce-93ef-c66656b17bad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405297
May 26 15:00:29.066844 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ae768-6a28-47ab-ae32-fe1d7828b944 req-255ea502-8cba-432b-aa05-f74117e98100 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:29.068345 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a01ae768-6a28-47ab-ae32-fe1d7828b944 req-255ea502-8cba-432b-aa05-f74117e98100 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0867441
May 26 15:00:29.113968 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a01ae768-6a28-47ab-ae32-fe1d7828b944 req-a4eaa934-5386-4a65-8416-867a19b3a69f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399220
May 26 15:00:29.180587 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3fd1be23-5491-47c3-b412-2cda12f5b672 req-ff4b8da6-b30d-405a-99d2-6de33e6ad968 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0451791
May 26 15:00:29.310318 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-881452d9-b17d-4ba9-aef2-cd9a10190765 req-e4fe12b3-2679-4b08-9767-0d1d6cca9419 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 210 time: 0.0422695
May 26 15:00:29.385417 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216c63a7-d3a9-4ece-84ca-094863fc8558 req-078d7458-6159-4624-a9a6-1a3600a8e30d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:29.387405 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-216c63a7-d3a9-4ece-84ca-094863fc8558 req-078d7458-6159-4624-a9a6-1a3600a8e30d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0838766
May 26 15:00:29.435567 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-216c63a7-d3a9-4ece-84ca-094863fc8558 req-6ec5a169-4f4a-453e-9743-b743a1f2dfdf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419476
May 26 15:00:29.664018 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-b91d9de3-6dd9-49f2-a45d-a5d2c71f9c46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:29.665456 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-b91d9de3-6dd9-49f2-a45d-a5d2c71f9c46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 815 time: 0.1576176
May 26 15:00:29.678779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Request body: {'port': {'device_id': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'admin_state_up': True, 'tenant_id': '1515325707f64d58a28f26451b2c74de'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:29.822940 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:29.827076 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Usage tracker for resource:port and tenant:1515325707f64d58a28f26451b2c74de is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:00:29.830734 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Quota usage for port was recalculated. Used quota:3. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:00:29.836513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:29.899040 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Made reservation on behalf of 1515325707f64d58a28f26451b2c74de for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:00:29.902761 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:30.070870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Allocated IP 172.20.0.11 (5bdb145e-267b-43cd-9426-f92f373c5ed5/a5c1fbe6-787f-4fc0-9f39-1179f60b94a5/7b7c8c36-6397-47d6-91bb-4f1db62a6e1a) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:30.303304 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:30.372904 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5f927055-d2c1-4a78-943f-de1606058959 req-3d38533e-7740-45ca-a164-1d87963e6348 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0510063
May 26 15:00:30.430836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:30.437639 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:30.446823 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df', '569fad69-3482-4ba8-829b-ffd9c0bc4482', '3ab2e391-3d42-467d-8e80-fe132717746c'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:00:30.457805 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-dd9c5833-7137-4c7a-aa90-faa06250e1f2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:30.457805 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-dd9c5833-7137-4c7a-aa90-faa06250e1f2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "GET /v2.0/networks?id=85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 200  len: 809 time: 0.2180681
May 26 15:00:30.473634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 req-1e7ad4b6-c533-46a9-8916-d0c021042db9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:30.475549 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 req-1e7ad4b6-c533-46a9-8916-d0c021042db9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.2195022
May 26 15:00:30.494985 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Request body: {'port': {'device_id': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a', 'admin_state_up': True, 'tenant_id': 'dffd269c3a344d36b77ebb04d0c412e3'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:30.511647 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Network 5bdb145e-267b-43cd-9426-f92f373c5ed5 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:30.515038 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:30.520750 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:30.638998 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event updated for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:30.657066 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 req-8ca7d5e2-3826-4995-a080-b97673fedbfc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1699140
May 26 15:00:30.680449 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:30.721092 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:30.721791 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:30.736297 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:30.751456 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:30.830251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e69492-c747-41b3-9b37-d4c6b204adcc req-7a44493d-b50f-46d9-a7ac-17dc7011a8e6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:30.842496 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-51e69492-c747-41b3-9b37-d4c6b204adcc req-7a44493d-b50f-46d9-a7ac-17dc7011a8e6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:30.845058 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Made reservation on behalf of dffd269c3a344d36b77ebb04d0c412e3 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:00:30.848723 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:30.870957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1957748
May 26 15:00:30.883922 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Request body: {'port': {'device_id': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:30.957197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-51e69492-c747-41b3-9b37-d4c6b204adcc req-7a44493d-b50f-46d9-a7ac-17dc7011a8e6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:30.968361 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-51e69492-c747-41b3-9b37-d4c6b204adcc req-7a44493d-b50f-46d9-a7ac-17dc7011a8e6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 932 time: 0.3935804
May 26 15:00:30.975852 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d53c026f-ddcc-4a56-9f32-eb40aead596f req-33f2ae22-22f3-4fb8-8860-b9c05b711079 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:30.983573 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d53c026f-ddcc-4a56-9f32-eb40aead596f req-33f2ae22-22f3-4fb8-8860-b9c05b711079 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.2115691
May 26 15:00:31.094097 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-51e69492-c747-41b3-9b37-d4c6b204adcc req-4a8c8b16-a7be-4702-8561-a7a26a146e35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1248214
May 26 15:00:31.096374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.189053 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d53c026f-ddcc-4a56-9f32-eb40aead596f req-f2862feb-1f22-4ac9-9e96-335bd2d1632e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2044439
May 26 15:00:31.199638 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Allocated IP 172.20.0.11 (85b44080-2458-40a2-bbbd-894b0448370a/1ffbc503-b2cb-4a9f-8705-0778bedb7314/e2b86960-bb59-4f27-9951-ec442358a17d) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:31.445666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.551399 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 req-69b6c262-0002-4d01-bcb8-3d7cafcd534b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0491285
May 26 15:00:31.562132 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.572112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:31.572547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c6ad0ae-8b82-414f-bfdd-d3be89325622 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:31.575396 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.590601 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Transition to ACTIVE for port object 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:31.638265 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Network 85b44080-2458-40a2-bbbd-894b0448370a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:31.642142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:31.646046 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:31.669888 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.674054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fef90b6-366b-4e7d-ba62-9bc64cbb8db6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:31.679200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Pushing event updated for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:31.688452 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:31.713312 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:31.713312 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.804724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Pushing event updated for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:31.814644 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3292999
May 26 15:00:31.827184 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Request body: {'port': {'device_id': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:31.833370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:31.915753 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Attempting to bind port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:31.916075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Attempting to bind port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:31.916395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Attempting to bind port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:31.920991 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:00:31.921299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Attempting to bind port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a on network 5bdb145e-267b-43cd-9426-f92f373c5ed5 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:31.926410 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:31.929064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Checking segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:31.929064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Bound using segment: {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:31.929064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Bound port: 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b964941b-0faf-494a-9f72-f6f580306e25', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1233, 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:31.929064 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:31.943071 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:32.024424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:32.028384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:32.095874 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:00:32.099547 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:32.112443 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:32.180620 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.181381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:32.182774 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] 10.222.0.32 "PUT /v2.0/ports/7b7c8c36-6397-47d6-91bb-4f1db62a6e1a HTTP/1.1" status: 200  len: 1094 time: 1.3039999
May 26 15:00:32.183264 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:32.216768 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Pushing event updated for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:32.220556 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:32.377831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-223c0c4b-4ba6-48dd-a206-decbb0b0103b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.379616 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-223c0c4b-4ba6-48dd-a206-decbb0b0103b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 1097 time: 0.0826049
May 26 15:00:32.440706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5ef5f5d-08a2-4876-b131-e68283f08d35 req-875e072d-9b17-48ee-97ab-ed3ceeeb50d2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.442247 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a5ef5f5d-08a2-4876-b131-e68283f08d35 req-875e072d-9b17-48ee-97ab-ed3ceeeb50d2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 944 time: 0.1795342
May 26 15:00:32.459335 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-3ce09ae1-4593-4053-9b92-4b3a4636d74a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a HTTP/1.1" status: 200  len: 217 time: 0.0717955
May 26 15:00:32.471769 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e2b86960-bb59-4f27-9951-ec442358a17d {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:32.481687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:32.521498 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a5ef5f5d-08a2-4876-b131-e68283f08d35 req-f4a6312b-724d-4346-a704-f9328cb77a1d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0720994
May 26 15:00:32.522656 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Transition to ACTIVE for port object e2b86960-bb59-4f27-9951-ec442358a17d will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:32.544625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-d7189658-0f5b-49dd-9de3-a500e45df1b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.546965 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-d7189658-0f5b-49dd-9de3-a500e45df1b3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 200  len: 855 time: 0.0733037
May 26 15:00:32.551554 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a', 'status': 'completed', 'code': 200}
May 26 15:00:32.615720 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-575ec6bf-bf60-4b4b-a037-ef3b6ce85e48 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=5bdb145e-267b-43cd-9426-f92f373c5ed5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0479453
May 26 15:00:32.660695 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:32.670253 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd4dc084-896d-4452-9f2a-503bea6a7d02 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:32.817207 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-b9aa7a64-fdd3-4d53-ba54-1b1f7fa59cdb service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1922011
May 26 15:00:32.832668 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35e83f89-c87c-48ea-9131-53c5251e761d req-0896c265-1c75-41fc-bf87-1af2e1df2e96 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.834105 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-35e83f89-c87c-48ea-9131-53c5251e761d req-0896c265-1c75-41fc-bf87-1af2e1df2e96 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 944 time: 0.1323457
May 26 15:00:32.877932 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Pushing event updated for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:32.885521 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:32.918269 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 req-f07e5bca-d2db-45a8-8049-c5e3f5134011 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:32.919756 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 req-f07e5bca-d2db-45a8-8049-c5e3f5134011 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.3027749
May 26 15:00:32.959010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Attempting to bind port e2b86960-bb59-4f27-9951-ec442358a17d on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:00:32.959010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Attempting to bind port e2b86960-bb59-4f27-9951-ec442358a17d by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:00:32.959010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Attempting to bind port e2b86960-bb59-4f27-9951-ec442358a17d on network 85b44080-2458-40a2-bbbd-894b0448370a {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:32.966187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Port e2b86960-bb59-4f27-9951-ec442358a17d on network 85b44080-2458-40a2-bbbd-894b0448370a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:00:32.966534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Attempting to bind port e2b86960-bb59-4f27-9951-ec442358a17d on network 85b44080-2458-40a2-bbbd-894b0448370a {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:00:32.966959 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-35e83f89-c87c-48ea-9131-53c5251e761d req-e84422f4-7352-4837-b492-b41191fa2818 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1116366
May 26 15:00:32.984093 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:00:32.984093 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Checking segment: {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:00:32.984506 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Bound using segment: {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:00:32.985146 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Bound port: e2b86960-bb59-4f27-9951-ec442358a17d, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '68a5ec6b-7a18-4714-970b-4f682bf72674', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:00:32.985146 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:33.005383 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 req-2c78316b-000f-469b-83ae-6c69225d11d0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0744545
May 26 15:00:33.012302 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9557a1b0-ce70-4a92-926e-ae3341e882ae req-4f4f1852-e89f-4f1c-9042-8d7f173cbda0 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1772430
May 26 15:00:33.080975 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:00:33.084161 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e2b86960-bb59-4f27-9951-ec442358a17d,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:00:33.174381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:33.178593 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0b235d3a-9fb3-4949-9c55-635b6d2ced5c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:33.242017 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a8270-160b-44e8-91b0-b38afca2379a req-11707a98-62ed-4f66-86cb-0084845bb27d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.243674 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-11707a98-62ed-4f66-86cb-0084845bb27d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1515325707f64d58a28f26451b2c74de&device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 1097 time: 0.0818059
May 26 15:00:33.244447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.245061 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:33.246397 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] 10.222.0.32 "PUT /v2.0/ports/e2b86960-bb59-4f27-9951-ec442358a17d HTTP/1.1" status: 200  len: 1094 time: 1.4235909
May 26 15:00:33.246877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:33.266753 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Pushing event updated for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:33.269974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:33.314231 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d', 'status': 'completed', 'code': 200}
May 26 15:00:33.399458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a8270-160b-44e8-91b0-b38afca2379a req-d8750454-a594-4dfe-ad2f-4b8b30468103 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.401467 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-d8750454-a594-4dfe-ad2f-4b8b30468103 service neutron] 10.222.0.32 "GET /v2.0/networks?id=5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 200  len: 917 time: 0.1471336
May 26 15:00:33.438976 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-e438b422-fc21-404c-b1f0-4dc6a29fbcf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.446114 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-e438b422-fc21-404c-b1f0-4dc6a29fbcf8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 1097 time: 0.0876219
May 26 15:00:33.485522 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-e25430b5-b0c5-4138-9096-1b4104731a6c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a HTTP/1.1" status: 200  len: 217 time: 0.0754805
May 26 15:00:33.562819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24a8270-160b-44e8-91b0-b38afca2379a req-7522963e-655c-4181-afbc-ff32dcdc12d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.564993 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-7522963e-655c-4181-afbc-ff32dcdc12d5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 200  len: 855 time: 0.0684545
May 26 15:00:33.705973 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-bd267106-f789-4160-9628-defe7a3046a5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=5bdb145e-267b-43cd-9426-f92f373c5ed5&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1319773
May 26 15:00:33.764583 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-73e0aadf-cd63-4ed0-a291-4ef2daed28d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.766398 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-73e0aadf-cd63-4ed0-a291-4ef2daed28d8 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&shared=False HTTP/1.1" status: 200  len: 911 time: 0.3017910
May 26 15:00:33.887970 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04badf84-e46c-4912-be28-c576e0f421c7 req-e944ed5c-4325-4750-b654-eb883060467a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.889477 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04badf84-e46c-4912-be28-c576e0f421c7 req-e944ed5c-4325-4750-b654-eb883060467a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1825728
May 26 15:00:33.930725 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-bb9293f0-b54d-4aa3-b414-3e36b0c43b83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:33.932370 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-bb9293f0-b54d-4aa3-b414-3e36b0c43b83 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1577213
May 26 15:00:33.979912 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-04badf84-e46c-4912-be28-c576e0f421c7 req-0ca4cd17-d1b8-436e-904f-024f3c73f173 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0734982
May 26 15:00:33.984614 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-39180a84-e3cd-4549-91a6-3284d95a496b service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2295899
May 26 15:00:34.066032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-78e2962b-4cd6-4ac2-8dbb-b18b40f5d4db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:34.067691 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-78e2962b-4cd6-4ac2-8dbb-b18b40f5d4db service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 1097 time: 0.0949857
May 26 15:00:34.170372 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-571eabc0-394c-43f9-ba1a-a818ca18b533 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=e2b86960-bb59-4f27-9951-ec442358a17d HTTP/1.1" status: 200  len: 217 time: 0.0915003
May 26 15:00:34.287415 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-b3295f23-a20f-4645-ac91-9efdafe2fcc1 service neutron] 10.222.0.32 "GET /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2949481
May 26 15:00:34.296477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 req-86372869-b15a-4b80-aa73-1bbae2d2bd85 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:34.304292 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 req-86372869-b15a-4b80-aa73-1bbae2d2bd85 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 944 time: 0.1882563
May 26 15:00:34.332216 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-d23b26b0-577a-4f9c-9150-6a27f273d16a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:34.334340 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-d23b26b0-577a-4f9c-9150-6a27f273d16a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1ffbc503-b2cb-4a9f-8705-0778bedb7314 HTTP/1.1" status: 200  len: 849 time: 0.1552584
May 26 15:00:34.374979 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 req-9ba8afb5-2198-4a8d-8383-a55eed2e9d93 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0689514
May 26 15:00:34.375212 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 58910) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:00:34.419115 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-4f77c54b-64c7-45ad-a66d-f28aae50a6c4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=85b44080-2458-40a2-bbbd-894b0448370a&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0680296
May 26 15:00:34.427713 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42907c1-df50-44aa-8810-204e910730d7 req-ed9696f4-4ed3-4380-b6c8-26a0d4997940 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:34.429101 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e42907c1-df50-44aa-8810-204e910730d7 req-ed9696f4-4ed3-4380-b6c8-26a0d4997940 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:34.554539 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e42907c1-df50-44aa-8810-204e910730d7 req-ed9696f4-4ed3-4380-b6c8-26a0d4997940 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:34.555706 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e42907c1-df50-44aa-8810-204e910730d7 req-ed9696f4-4ed3-4380-b6c8-26a0d4997940 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 944 time: 0.3175933
May 26 15:00:34.602721 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-1e5c167f-3b05-4614-9623-080203d8d9b4 service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.2260695
May 26 15:00:34.627097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1580e60-e590-4db9-9473-864e38d9370d req-16d13d5f-8387-469e-b0fc-5326c3660e9a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:34.628615 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e1580e60-e590-4db9-9473-864e38d9370d req-16d13d5f-8387-469e-b0fc-5326c3660e9a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1472719
May 26 15:00:34.647543 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-20623a37-70b1-4525-88ed-8a34982264ec service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2108510
May 26 15:00:34.656440 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e42907c1-df50-44aa-8810-204e910730d7 req-6c74e7b1-f6a7-42e0-82b5-d2cd63bdd3ab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0881596
May 26 15:00:34.698204 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e1580e60-e590-4db9-9473-864e38d9370d req-1f1b2d83-2550-48a5-892e-319dd9d32cae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0625248
May 26 15:00:34.823792 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a req-f9cb2b29-c534-46e2-b157-818d19712263 service neutron] 10.222.0.32 "GET /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1654754
May 26 15:00:35.181987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85420024-5f97-4604-af40-b53f7245405e req-edfd0fc4-312f-485c-8403-2a534a77ba9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:35.181987 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-85420024-5f97-4604-af40-b53f7245405e req-edfd0fc4-312f-485c-8403-2a534a77ba9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0809855
May 26 15:00:35.232481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-85420024-5f97-4604-af40-b53f7245405e req-1cd5f297-2fd0-47b1-a795-8f4ff0ef2d36 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0429714
May 26 15:00:35.451231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cde1161-5659-4fcd-885d-bb2954032e9a req-23c18c1b-8356-433f-a96e-47be2cc77381 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:35.453701 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6cde1161-5659-4fcd-885d-bb2954032e9a req-23c18c1b-8356-433f-a96e-47be2cc77381 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.0898035
May 26 15:00:35.498837 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6cde1161-5659-4fcd-885d-bb2954032e9a req-8caa1bb3-27cc-4034-8fd7-483cfc1837f6 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0379002
May 26 15:00:35.565920 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7287ced-7e61-4fcc-8844-87fdc03a16fe req-15e27ff3-bfa4-4e26-b855-299575f0bec3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:35.570418 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e7287ced-7e61-4fcc-8844-87fdc03a16fe req-15e27ff3-bfa4-4e26-b855-299575f0bec3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 944 time: 0.0861270
May 26 15:00:35.622351 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e7287ced-7e61-4fcc-8844-87fdc03a16fe req-6388d673-7b74-4ea4-9dfa-77abe4b2ef21 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413587
May 26 15:00:35.892524 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4550e46b-de57-4768-b7d3-067c61f11dc8 req-fddafc03-1136-439d-9357-fe035e210247 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:35.898600 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4550e46b-de57-4768-b7d3-067c61f11dc8 req-fddafc03-1136-439d-9357-fe035e210247 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 944 time: 0.1101134
May 26 15:00:35.906167 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b req-4f40f189-f20a-4048-b5d8-66b4e388d08d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:35.908519 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b req-4f40f189-f20a-4048-b5d8-66b4e388d08d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0967197
May 26 15:00:35.947930 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4550e46b-de57-4768-b7d3-067c61f11dc8 req-1fe329b8-bdef-4612-8ec2-6b9ebafa8b06 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0479581
May 26 15:00:35.971775 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b req-f396f7cb-40a1-4f2f-85a5-c885c739d953 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553207
May 26 15:00:36.132600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:00:36.271090 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:36.285866 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a', 'network_id': '5bdb145e-267b-43cd-9426-f92f373c5ed5', 'port_id': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a', 'mac_address': 'fa:16:3e:e8:47:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a5c1fbe6-787f-4fc0-9f39-1179f60b94a5', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:00:36.358343 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:36.375042 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:36.391611 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:36.432855 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39200179-4cea-4c01-9591-bdeb690b62a0 req-cb535acd-2efc-4ce0-8e0b-df319d45bf9a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:36.434337 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-39200179-4cea-4c01-9591-bdeb690b62a0 req-cb535acd-2efc-4ce0-8e0b-df319d45bf9a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0793531
May 26 15:00:36.470405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:36.472114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:36.481051 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-39200179-4cea-4c01-9591-bdeb690b62a0 req-0cfb8de1-ab3e-446f-b874-7c2de1019192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404170
May 26 15:00:36.542538 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:36.556501 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:36.821668 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff5cdfc7-015d-4906-a4d7-69e353732c88 req-04cec23a-c1da-45e0-8aae-faa10c266d4b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:36.823292 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ff5cdfc7-015d-4906-a4d7-69e353732c88 req-04cec23a-c1da-45e0-8aae-faa10c266d4b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 945 time: 0.0904288
May 26 15:00:36.870203 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ff5cdfc7-015d-4906-a4d7-69e353732c88 req-5918cb71-e854-44b8-877d-d8432a024953 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395348
May 26 15:00:37.084169 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['7b7c8c36-6397-47d6-91bb-4f1db62a6e1a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:00:37.142876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b2153c3-c20f-4721-9931-043f9dd73f7b req-89371117-4905-4777-a488-915459638c2e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:37.144365 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b2153c3-c20f-4721-9931-043f9dd73f7b req-89371117-4905-4777-a488-915459638c2e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 944 time: 0.0903344
May 26 15:00:37.196262 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9b2153c3-c20f-4721-9931-043f9dd73f7b req-724e1d16-f3ad-412d-ac0a-c5685d9b13ae tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456381
May 26 15:00:37.217513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 req-d89f06b7-0877-4542-bc99-094563c8ce1e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:37.222041 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 req-d89f06b7-0877-4542-bc99-094563c8ce1e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0993414
May 26 15:00:37.270045 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 req-e4acd623-28e4-476d-8849-e4fa0b0a35fc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0470061
May 26 15:00:37.377523 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027deb6b-cfde-46c1-b1a4-c805d0435958 req-1295f534-b4d8-4b3e-a581-8c2c3a476215 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:37.379018 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-027deb6b-cfde-46c1-b1a4-c805d0435958 req-1295f534-b4d8-4b3e-a581-8c2c3a476215 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.0844715
May 26 15:00:37.425359 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-027deb6b-cfde-46c1-b1a4-c805d0435958 req-f271576d-7e7c-4915-a729-457b51dfacaa tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0403705
May 26 15:00:37.682878 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd req-d5d5489f-bcc1-4cbe-a7cb-237230674d37 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:37.684325 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd req-d5d5489f-bcc1-4cbe-a7cb-237230674d37 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0848966
May 26 15:00:37.729047 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd req-b80b6026-39d6-4e6b-ad4e-4db8ce30478e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0384657
May 26 15:00:37.965717 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-246d2eb9-3a56-40dd-8620-77f8304774b5 req-c415162f-38ba-44ab-974a-94a7fa64132d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:37.967298 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-246d2eb9-3a56-40dd-8620-77f8304774b5 req-c415162f-38ba-44ab-974a-94a7fa64132d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0926387
May 26 15:00:38.019557 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-246d2eb9-3a56-40dd-8620-77f8304774b5 req-79754cfb-8939-4f5c-974e-756098ab748b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0457089
May 26 15:00:38.154108 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e2b86960-bb59-4f27-9951-ec442358a17d details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:00:38.161624 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-11c14017-6853-42e2-8e60-4b2e45397783 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.163102 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-11c14017-6853-42e2-8e60-4b2e45397783 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 1098 time: 0.2267926
May 26 15:00:38.209156 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf8b2ed-4622-44b4-823a-1c890d7023ae req-37965a46-6de2-4eda-b362-ad0829bd4b66 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.211350 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-edf8b2ed-4622-44b4-823a-1c890d7023ae req-37965a46-6de2-4eda-b362-ad0829bd4b66 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 945 time: 0.2126212
May 26 15:00:38.324743 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e2b86960-bb59-4f27-9951-ec442358a17d,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:38.336928 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-edf8b2ed-4622-44b4-823a-1c890d7023ae req-09e49f1b-9001-4ded-90ac-80a84ad30c70 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0744843
May 26 15:00:38.339467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'e2b86960-bb59-4f27-9951-ec442358a17d', 'network_id': '85b44080-2458-40a2-bbbd-894b0448370a', 'port_id': 'e2b86960-bb59-4f27-9951-ec442358a17d', 'mac_address': 'fa:16:3e:54:24:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1239, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1ffbc503-b2cb-4a9f-8705-0778bedb7314', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:00:38.367305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-63279722-d2a6-4483-90a9-5c878e1607b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.368955 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-63279722-d2a6-4483-90a9-5c878e1607b6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1970003
May 26 15:00:38.398290 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:38.412085 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 req-c7150885-4506-4401-aa3f-9eaaa0cdfdf5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.413579 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 req-c7150885-4506-4401-aa3f-9eaaa0cdfdf5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 944 time: 0.0913920
May 26 15:00:38.418595 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e2b86960-bb59-4f27-9951-ec442358a17d {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:38.435715 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e2b86960-bb59-4f27-9951-ec442358a17d,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:38.443471 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-828f8f34-78e0-4e8b-8682-31e7fc737900 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 200  len: 217 time: 0.0663660
May 26 15:00:38.464698 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 req-d7028b49-702a-4d9d-adcf-61c2d471d5b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0447505
May 26 15:00:38.492689 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:38.495023 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:38.509706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-2bf8d6ec-7507-4928-8440-538a180d0930 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.511647 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-2bf8d6ec-7507-4928-8440-538a180d0930 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.0607097
May 26 15:00:38.569634 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:38.574454 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:38.601171 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-b768ca24-5ebd-4de4-9706-2854f6c2c7b6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0758569
May 26 15:00:38.750445 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2a58c65-1f03-48a1-8554-a66b1252fcec req-2baab1a1-8d83-4f83-b652-176f32c83f9d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.751912 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2a58c65-1f03-48a1-8554-a66b1252fcec req-2baab1a1-8d83-4f83-b652-176f32c83f9d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.1910775
May 26 15:00:38.791755 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-9ebe79e6-355d-4d8f-939f-0b704a5b4a3d service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1678789
May 26 15:00:38.794269 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-188560e9-1036-4c44-8e61-dc07955f97ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.795753 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-188560e9-1036-4c44-8e61-dc07955f97ed service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 1097 time: 0.0822999
May 26 15:00:38.832441 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2a58c65-1f03-48a1-8554-a66b1252fcec req-f22f537d-9f7e-440e-9f3d-7e96ff4c1008 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683529
May 26 15:00:38.942494 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d96b21e9-25b1-4f86-acb8-ae989df6d96b req-0b5a67c1-bddd-4274-9cfe-95ccc617ab5f service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1348827
May 26 15:00:38.947340 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e2b86960-bb59-4f27-9951-ec442358a17d'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:00:38.977605 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-7a24161f-de5f-4386-a18f-4969525a90a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:38.980111 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-7a24161f-de5f-4386-a18f-4969525a90a4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1097 time: 0.1498172
May 26 15:00:38.999191 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df7641da-6e49-436f-8435-8bc62aa64bfa req-a2fad29e-f454-49ba-8595-34cbcbd69e53 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.006598 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-df7641da-6e49-436f-8435-8bc62aa64bfa req-a2fad29e-f454-49ba-8595-34cbcbd69e53 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1389089
May 26 15:00:39.141957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-df7641da-6e49-436f-8435-8bc62aa64bfa req-82eb07a0-e685-487a-8419-38e07aa5bd8a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1338844
May 26 15:00:39.223060 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a162c9-1532-4141-a3a2-f65dbb85a09d req-96186af6-9a00-4180-84d9-414c702bdcf8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.225339 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f3a162c9-1532-4141-a3a2-f65dbb85a09d req-96186af6-9a00-4180-84d9-414c702bdcf8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0921071
May 26 15:00:39.247068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-fae23640-24b3-49fc-ad24-b8d7a03a2eb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.248522 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-fae23640-24b3-49fc-ad24-b8d7a03a2eb3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.2139018
May 26 15:00:39.270484 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f3a162c9-1532-4141-a3a2-f65dbb85a09d req-b01b01c9-64c6-4dd2-9378-a68eb7e83249 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392306
May 26 15:00:39.355947 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-0f152175-5ad8-465f-b7e5-b44325f283b5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 999 time: 0.0949492
May 26 15:00:39.429440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-acb381d7-b0e3-406f-aee2-c300fe155d17 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.430845 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-acb381d7-b0e3-406f-aee2-c300fe155d17 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0608208
May 26 15:00:39.584451 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-43b2395b-1bd0-4494-9489-5c1f88c76fca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.585983 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-43b2395b-1bd0-4494-9489-5c1f88c76fca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1403286
May 26 15:00:39.597662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 req-19b3a4db-4579-4928-bfc8-10f65735d37b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.599047 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 req-19b3a4db-4579-4928-bfc8-10f65735d37b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 945 time: 0.1155002
May 26 15:00:39.713813 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d8b240-7362-4d25-8bc6-27e11aaa2630 req-39f2bbf1-45b6-4397-9881-fbb483d728fa tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.715197 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-25d8b240-7362-4d25-8bc6-27e11aaa2630 req-39f2bbf1-45b6-4397-9881-fbb483d728fa tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 945 time: 0.1447079
May 26 15:00:39.725591 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 req-714e0a4c-5294-41cf-9093-13ed3b4e1484 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1079428
May 26 15:00:39.746187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-48ebd0bf-c8dd-4ffc-b5ac-a2c06adfa225 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:39.747613 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-48ebd0bf-c8dd-4ffc-b5ac-a2c06adfa225 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.1409283
May 26 15:00:39.765518 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-11c82ad5-6cfe-4866-b07d-883c7f5e6aea service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1655569
May 26 15:00:39.821264 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-25d8b240-7362-4d25-8bc6-27e11aaa2630 req-67631c5d-f539-4da5-aa7b-9b399b0b07cd tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0990188
May 26 15:00:39.900557 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a req-5155b1b7-029f-4de8-8aab-f6a3f0c17495 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1264887
May 26 15:00:39.912728 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Deleting port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:00:39.913594 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.044349 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a25a32-e72d-47ef-b41e-b69e59806c02 req-b396dec7-5aa2-48e0-9326-314d67505003 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:40.046006 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-32a25a32-e72d-47ef-b41e-b69e59806c02 req-b396dec7-5aa2-48e0-9326-314d67505003 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 946 time: 0.1012847
May 26 15:00:40.071171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] For port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:40.071512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.093612 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-32a25a32-e72d-47ef-b41e-b69e59806c02 req-5e3594e8-bf46-48b1-944a-c8c61a59fd40 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0406086
May 26 15:00:40.163430 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:40.199480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling delete_port for 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 owned by compute:nova {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:00:40.287973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:40.293176 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:40.298816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.461434 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.491135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.497894 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:40.502847 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-01ddc2b6-85dc-4292-ab40-7bd752452bc1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:40.505784 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e req-e587bebf-7ca6-4e42-b00f-1bb60e63365c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:40.507645 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e req-e587bebf-7ca6-4e42-b00f-1bb60e63365c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1042597
May 26 15:00:40.510098 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:40.558926 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Pushing event deleted for resources: {'Port': ['ID=6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:40.561493 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:40.562401 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e req-42973da3-48c0-4e5e-aa79-a7ef42563fa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0494006
May 26 15:00:40.574023 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.575513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e2b86960-bb59-4f27-9951-ec442358a17d up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:00:40.633197 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:40.658480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] No DVR routers for this DVR port 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 on host hv-cinder-78414 {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:00:40.661679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.666342 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'name': 'network-vif-deleted', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:40.671137 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a', 'code': 200}
May 26 15:00:40.725646 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d41c21ef-48e2-4992-a236-cb64793af9c7 req-68c66661-4091-4e86-a531-09ad62ce9cf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:40.728331 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d41c21ef-48e2-4992-a236-cb64793af9c7 req-68c66661-4091-4e86-a531-09ad62ce9cf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.4424844
May 26 15:00:40.733942 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:40.737817 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:40.753993 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '990431e1-82cb-42b0-a288-949d79e21762', 'name': 'network-vif-deleted', 'tag': '6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15', 'status': 'completed', 'code': 200}
May 26 15:00:40.802420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port e2b86960-bb59-4f27-9951-ec442358a17d completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:40.806372 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ec9e9921-0f67-4571-8b14-a15cda4ed47d req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "DELETE /v2.0/ports/6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 HTTP/1.1" status: 204  len: 173 time: 1.0426393
May 26 15:00:40.807893 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port e2b86960-bb59-4f27-9951-ec442358a17d triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:40.808274 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:40.834625 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d41c21ef-48e2-4992-a236-cb64793af9c7 req-15a598f7-b6aa-4323-886a-63a19737f1ad tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0959511
May 26 15:00:41.037342 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:41.105137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89575392-3d98-4a7a-bc13-5544c9cc6b32 req-c44fc4fa-2bed-42d7-a9f6-d8eb48953b73 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:41.107848 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-89575392-3d98-4a7a-bc13-5544c9cc6b32 req-c44fc4fa-2bed-42d7-a9f6-d8eb48953b73 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1238072
May 26 15:00:41.112546 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e2b86960-bb59-4f27-9951-ec442358a17d,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:00:41.144501 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4c9138-3fea-4035-bf38-58f23a394455 req-cf7d1956-0f1a-429e-b4f0-b3fd5fc94ab0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:41.152907 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8d4c9138-3fea-4035-bf38-58f23a394455 req-cf7d1956-0f1a-429e-b4f0-b3fd5fc94ab0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 945 time: 0.1418097
May 26 15:00:41.195893 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:41.196771 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:00:41.207207 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-89575392-3d98-4a7a-bc13-5544c9cc6b32 req-7e9df24b-bd62-4235-bc60-dc4794dda9b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0921078
May 26 15:00:41.220965 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8d4c9138-3fea-4035-bf38-58f23a394455 req-8b3a547f-872d-45e7-8eca-4b3d475c49e0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0631073
May 26 15:00:41.258654 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:41.318728 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:00:41.318728 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:00:41.358979 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:41.363375 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:41.391312 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-11229648-eec8-466f-9ac9-0c2e29058600 req-c220d689-dc25-4bff-8a82-b864e88f6fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0536380
May 26 15:00:41.763663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 req-27ed334e-a330-4cb1-8809-03599095f22c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:41.765140 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 req-27ed334e-a330-4cb1-8809-03599095f22c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0875158
May 26 15:00:41.815444 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 req-16bc81fa-f511-41c3-9e9c-17c334e0a095 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430458
May 26 15:00:42.065324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd req-53f01925-af1a-4eb7-ab0f-1eee0cd16aa5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:42.066841 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd req-53f01925-af1a-4eb7-ab0f-1eee0cd16aa5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0853498
May 26 15:00:42.114127 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd req-c4065e4e-65a1-442c-8e40-12461467b130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415432
May 26 15:00:42.409345 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7dbb782-382e-4638-8d98-82b054bb46ae req-f6f96108-c070-49ec-89e6-1c9b17aec4e9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:42.412928 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d7dbb782-382e-4638-8d98-82b054bb46ae req-f6f96108-c070-49ec-89e6-1c9b17aec4e9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0856640
May 26 15:00:42.420489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb req-8c40676a-5ec5-4bdd-8f7c-532d727773ae tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:42.422756 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb req-8c40676a-5ec5-4bdd-8f7c-532d727773ae tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0875013
May 26 15:00:42.476166 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d7dbb782-382e-4638-8d98-82b054bb46ae req-c22adcc9-3f2f-41d3-b8e2-b319c8f01984 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0575585
May 26 15:00:42.498676 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb req-46d5c971-6a2a-4df0-9354-2e65f61961e3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680840
May 26 15:00:42.621343 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b req-785eee9c-c29b-43f6-8d7d-23ec59744d95 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:42.672656 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:00:42.678848 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b req-785eee9c-c29b-43f6-8d7d-23ec59744d95 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:42.680039 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b req-785eee9c-c29b-43f6-8d7d-23ec59744d95 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0998447
May 26 15:00:42.722128 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d', 'code': 200}
May 26 15:00:43.013493 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8689f709-89ac-4618-9c77-7c0c92cda100 req-c6ea0f1b-97e1-4c41-ba0a-742c1d572f20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:43.015119 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8689f709-89ac-4618-9c77-7c0c92cda100 req-c6ea0f1b-97e1-4c41-ba0a-742c1d572f20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0904729
May 26 15:00:43.063625 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8689f709-89ac-4618-9c77-7c0c92cda100 req-16276fdb-dde1-419e-bb6e-5ad35c845d62 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412314
May 26 15:00:43.324531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-500b0950-e865-48af-a259-dc4aaec5f9e4 req-d52c45fa-cc57-4574-aa84-e7a2bc145ed1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:43.326243 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-500b0950-e865-48af-a259-dc4aaec5f9e4 req-d52c45fa-cc57-4574-aa84-e7a2bc145ed1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0930035
May 26 15:00:43.372240 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-500b0950-e865-48af-a259-dc4aaec5f9e4 req-052a9b34-ccd8-485a-91cd-79896d2a1b50 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399749
May 26 15:00:43.673565 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 req-976f20ea-ca11-473f-ae51-921894aa6ac4 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:43.678943 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 req-976f20ea-ca11-473f-ae51-921894aa6ac4 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0872409
May 26 15:00:43.690113 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 req-513f692f-31d3-40d1-b59e-6a30fc864261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:43.691616 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 req-513f692f-31d3-40d1-b59e-6a30fc864261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0884976
May 26 15:00:43.733471 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 req-5673951a-e7a7-401b-9699-36bb4d9dc8e2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0483456
May 26 15:00:43.743409 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 req-a2602477-71d2-412c-8480-8d49c624678c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461080
May 26 15:00:43.873532 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e0f375df-2fd2-4e15-804d-58460d2ee039 req-30c06311-c55e-439c-bcbe-ed9d3845beea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0429873
May 26 15:00:44.259588 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-329273e7-9459-4199-b5ea-a6e61fce7202 req-f44f58aa-b6f6-4483-b08a-46d639528735 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:44.261040 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-329273e7-9459-4199-b5ea-a6e61fce7202 req-f44f58aa-b6f6-4483-b08a-46d639528735 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0831418
May 26 15:00:44.306973 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-329273e7-9459-4199-b5ea-a6e61fce7202 req-e5b3ad21-5cf1-483f-a5f9-75a8de0203d0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394766
May 26 15:00:44.565688 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 req-ae7b2cb4-432c-4b0a-937e-d93ba4aa4ec5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:44.567192 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 req-ae7b2cb4-432c-4b0a-937e-d93ba4aa4ec5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0819654
May 26 15:00:44.626977 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 req-fb2fd6d2-32f5-4726-a84e-c9982edefd84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0534618
May 26 15:00:44.934550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 req-dd1ebc6b-ac02-4c4e-9c48-44f9b237242c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:44.936714 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 req-dd1ebc6b-ac02-4c4e-9c48-44f9b237242c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0921471
May 26 15:00:44.937154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158b51a9-d477-4b44-bae5-56f83870ad8e req-64e02fc1-9416-46e3-a014-024c6a59a39a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:44.939283 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-158b51a9-d477-4b44-bae5-56f83870ad8e req-64e02fc1-9416-46e3-a014-024c6a59a39a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0891755
May 26 15:00:44.985408 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-158b51a9-d477-4b44-bae5-56f83870ad8e req-9eb129ec-a58a-42f9-bcdd-ef38723db901 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401008
May 26 15:00:44.986156 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 req-6fe83612-c5ea-4e1b-83d2-9b71f4c376f9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401497
May 26 15:00:45.139097 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-78d5d218-0507-4cbc-8ff8-bebd305b638b req-d963a5fc-5f49-4ffa-92a7-99509f5038bd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0428059
May 26 15:00:45.498092 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 req-37e817e2-34d6-4d84-bec4-536763a28dce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:45.499581 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 req-37e817e2-34d6-4d84-bec4-536763a28dce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0821564
May 26 15:00:45.548121 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 req-ef624595-41c7-48d1-9589-58d7151900a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422258
May 26 15:00:45.836140 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 req-751f9329-a5dc-4213-a09a-64f916a1f984 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:45.837659 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 req-751f9329-a5dc-4213-a09a-64f916a1f984 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0852573
May 26 15:00:45.883534 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 req-921138c9-123a-403c-8d14-9cde2f2d3358 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400844
May 26 15:00:46.182163 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 req-7b9dca87-3c61-4506-a418-d4fbcb2753cc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:46.183727 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 req-7b9dca87-3c61-4506-a418-d4fbcb2753cc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0892625
May 26 15:00:46.238549 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 req-792088f0-d663-4f57-b4fa-debfa24aa711 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0475307
May 26 15:00:46.301746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b req-e34af365-9264-4290-9d49-e29b1ebfd51a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:46.309818 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b req-e34af365-9264-4290-9d49-e29b1ebfd51a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.2038984
May 26 15:00:46.353690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b req-fc7f91fa-a760-45ba-a510-a2305d9d6b15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0425951
May 26 15:00:46.396743 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 req-3b46a236-cea0-443b-946f-6820f0a6f2d8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0561941
May 26 15:00:46.754256 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98832112-2061-4d6e-a025-f067dd45cac8 req-7514d878-6433-4595-a9b1-9bd1babb3d12 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:46.755794 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98832112-2061-4d6e-a025-f067dd45cac8 req-7514d878-6433-4595-a9b1-9bd1babb3d12 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0957818
May 26 15:00:46.827596 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98832112-2061-4d6e-a025-f067dd45cac8 req-a92d9eaa-9848-4a41-b889-a9d6f82c480b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0655596
May 26 15:00:47.089191 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb32335-a65b-401f-bdda-16752eeb38f9 req-9f1baf97-6ad9-43fc-bc2e-f25c1458b9f0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:47.090630 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3cb32335-a65b-401f-bdda-16752eeb38f9 req-9f1baf97-6ad9-43fc-bc2e-f25c1458b9f0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0880156
May 26 15:00:47.141376 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3cb32335-a65b-401f-bdda-16752eeb38f9 req-4cff6f8d-fd5e-487a-8b3b-c73395b8f103 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442941
May 26 15:00:47.448448 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f583898c-6ad9-4f6d-8861-13dd5e70b628 req-f6058574-92e0-42ed-8b7e-b8fc8cf3a445 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:47.451551 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f583898c-6ad9-4f6d-8861-13dd5e70b628 req-f6058574-92e0-42ed-8b7e-b8fc8cf3a445 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1021810
May 26 15:00:47.509466 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f583898c-6ad9-4f6d-8861-13dd5e70b628 req-6c5f481b-0485-4b07-8d1a-67fe3501d845 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0514972
May 26 15:00:47.583706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95804d78-25be-46ca-b226-57cadc7dea3c req-d4c29a2e-50e3-4d52-a160-fabbd2f66b85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:47.588355 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-95804d78-25be-46ca-b226-57cadc7dea3c req-d4c29a2e-50e3-4d52-a160-fabbd2f66b85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.1063633
May 26 15:00:47.637116 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-95804d78-25be-46ca-b226-57cadc7dea3c req-c59f4452-e977-4ca1-9bc2-1f0b6f0ef3b3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0430467
May 26 15:00:47.664313 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6eb02a60-af93-4192-b9e7-0190bc092a73 req-f152f287-9617-45db-9b4d-23da490f1492 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0496387
May 26 15:00:48.022393 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddd3da4f-a3bf-4e60-a322-058e10afe552 req-2b0376da-0502-42ec-ad5a-1a5c8fb9674b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:48.024674 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ddd3da4f-a3bf-4e60-a322-058e10afe552 req-2b0376da-0502-42ec-ad5a-1a5c8fb9674b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0897269
May 26 15:00:48.070781 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ddd3da4f-a3bf-4e60-a322-058e10afe552 req-0ea46f18-99d3-4fd1-9679-7350371e40fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0401497
May 26 15:00:48.135483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-0617d490-4782-4c59-ab81-a2b3d90abd10 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:48.252876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-0617d490-4782-4c59-ab81-a2b3d90abd10 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:48.260723 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-0617d490-4782-4c59-ab81-a2b3d90abd10 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1398860261&fields=id&tenant_id=07c65d1e254f424ebfea8360aa697c34 HTTP/1.1" status: 200  len: 267 time: 0.1735413
May 26 15:00:48.348972 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67ac37fb-350d-471a-ad2c-b4ce47253a17 req-73f22c8f-41c6-4092-ac33-08b88ab201c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:48.350504 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67ac37fb-350d-471a-ad2c-b4ce47253a17 req-73f22c8f-41c6-4092-ac33-08b88ab201c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0901213
May 26 15:00:48.399575 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67ac37fb-350d-471a-ad2c-b4ce47253a17 req-a2ec6b2d-a317-4852-9599-432cdf4a1c53 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426888
May 26 15:00:48.413974 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-7a276da6-d1c6-49e8-9101-c8786dee52a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:48.415439 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-7a276da6-d1c6-49e8-9101-c8786dee52a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 809 time: 0.1536348
May 26 15:00:48.431328 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-920206f8-fe61-409c-87a1-942552d5779d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/quotas/07c65d1e254f424ebfea8360aa697c34 HTTP/1.1" status: 200  len: 375 time: 0.0100133
May 26 15:00:48.529571 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-c0ebca6c-70f5-40a6-b55d-58f4e52c0c22 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0929887
May 26 15:00:48.722101 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-7934cd3b-a55f-49b5-b67b-5f80813761ba service neutron] 10.222.0.81 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1782472
May 26 15:00:48.777288 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50a073fe-7026-4656-9952-ac2c3988dc9c req-7d93cfb6-eb95-4c27-a053-32ea0b916758 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:48.780945 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-50a073fe-7026-4656-9952-ac2c3988dc9c req-7d93cfb6-eb95-4c27-a053-32ea0b916758 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0933406
May 26 15:00:48.827525 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-50a073fe-7026-4656-9952-ac2c3988dc9c req-3e4ab2ee-641e-4884-8db8-76433ea7f771 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422139
May 26 15:00:48.866552 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-f2b516ae-b394-43e4-b915-1f3a9c74c4c5 service neutron] 10.222.0.81 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1383810
May 26 15:00:49.035806 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11ca62c8-f78b-4de8-b286-7422af037c9f req-c52218f7-f4fa-4aa8-8b99-4bb185f5b24d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:49.037353 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-11ca62c8-f78b-4de8-b286-7422af037c9f req-c52218f7-f4fa-4aa8-8b99-4bb185f5b24d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0899270
May 26 15:00:49.095579 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-11ca62c8-f78b-4de8-b286-7422af037c9f req-3b0ce54b-f646-4706-870f-848ae7fca496 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410511
May 26 15:00:49.323924 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2a726887-6fb2-4273-a5a5-29230a904a7f req-0bf6e5fb-2827-471d-9737-510ae7a2ebbe tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.1236873
May 26 15:00:49.513860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f772473d-4122-40e9-86ea-487182a784be req-ec0344c9-9e00-4970-8b64-0589d7de247e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:49.515393 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f772473d-4122-40e9-86ea-487182a784be req-ec0344c9-9e00-4970-8b64-0589d7de247e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0879712
May 26 15:00:49.570024 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f772473d-4122-40e9-86ea-487182a784be req-f532ae84-069d-44cc-b572-fb49ea9136db tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0481563
May 26 15:00:49.755425 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 req-fda87c4c-3dd9-453b-a3bc-74b717a50ac3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:49.756953 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 req-fda87c4c-3dd9-453b-a3bc-74b717a50ac3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0857098
May 26 15:00:49.804283 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 req-8bd644c1-cf9d-44de-adfa-ef5cd1a9e94b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413918
May 26 15:00:50.048539 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 req-af20afd9-64d5-4c2e-be14-0dbbe1200120 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:50.055475 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-38be1b39-3b2e-4e4c-966c-2202dd82a160 req-14d762f4-5905-4c05-89f9-251550477cea tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0887167
May 26 15:00:50.058798 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 req-af20afd9-64d5-4c2e-be14-0dbbe1200120 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1069596
May 26 15:00:50.124757 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 req-7e4f6d7c-4264-4246-8b8b-42baef1394ff tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0597517
May 26 15:00:50.286363 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6326e01b-45f6-40d5-8ce8-aa554e46a95f req-f008a0e0-533d-4d8f-9320-e37fac74a715 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:50.287849 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6326e01b-45f6-40d5-8ce8-aa554e46a95f req-f008a0e0-533d-4d8f-9320-e37fac74a715 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0866995
May 26 15:00:50.345308 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6326e01b-45f6-40d5-8ce8-aa554e46a95f req-c965b452-1d8d-4c20-a36f-a30456db3e28 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0434546
May 26 15:00:50.491965 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 req-6600004b-3fad-4dac-8d42-165b7116ed19 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0509107
May 26 15:00:50.613534 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f835f631-7b84-447c-83c9-fa39761b5eb6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:50.771335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e923653-ab4f-46cb-8301-90397da00df0 req-48d48c43-8b70-4fad-bece-350563fd4d2f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:50.772752 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7e923653-ab4f-46cb-8301-90397da00df0 req-48d48c43-8b70-4fad-bece-350563fd4d2f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0869105
May 26 15:00:50.823000 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7e923653-ab4f-46cb-8301-90397da00df0 req-59777063-bc05-464c-80e2-97a12faedbce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0441325
May 26 15:00:51.028645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e req-d1dd6544-3b6e-4618-95e6-a0d8bdc242c2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:51.030181 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e req-d1dd6544-3b6e-4618-95e6-a0d8bdc242c2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0937152
May 26 15:00:51.079681 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e req-d05d35c9-3bdc-4485-a260-89dc17c1941f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427814
May 26 15:00:51.150850 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98a6849c-c950-43d1-a5e1-47d3e1064d68 req-aa3a6352-e658-47d2-91c5-31f670aa5069 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0470009
May 26 15:00:51.336761 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc req-8de24dbc-14f3-4f48-a5fa-a8efcda68380 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:51.336761 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc req-8de24dbc-14f3-4f48-a5fa-a8efcda68380 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0872855
May 26 15:00:51.374636 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc req-1a2f5d17-255f-47f4-ad52-fe57a0b92ea2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419586
May 26 15:00:51.618578 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2514a472-46ca-4d6e-947b-41a8ea526b78 req-28c95b5a-8d90-433d-9f07-77436e0392fd tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:51.620176 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2514a472-46ca-4d6e-947b-41a8ea526b78 req-28c95b5a-8d90-433d-9f07-77436e0392fd tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0983694
May 26 15:00:51.666788 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d307d6fb-18b2-4209-a155-13b48a780e7f req-e99a1d6b-6671-4e7d-b58f-fa1acecaad07 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0464234
May 26 15:00:51.674014 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2514a472-46ca-4d6e-947b-41a8ea526b78 req-51329dbd-efb8-485b-bef0-8b190de73196 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0476675
May 26 15:00:52.020042 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36ede29-6210-43b4-9eb9-2c606ebbc74f req-12d0c322-ea8d-460a-929e-12b12a749690 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:52.021692 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c36ede29-6210-43b4-9eb9-2c606ebbc74f req-12d0c322-ea8d-460a-929e-12b12a749690 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0861392
May 26 15:00:52.069734 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c36ede29-6210-43b4-9eb9-2c606ebbc74f req-c9c42d61-f78e-4226-960d-4b0a90bba6c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0420454
May 26 15:00:52.287414 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0260ca2-35db-467c-88ec-2158dd5330b4 req-12b1c72f-60fb-489f-a629-cba5154ddea3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:52.288021 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b0260ca2-35db-467c-88ec-2158dd5330b4 req-12b1c72f-60fb-489f-a629-cba5154ddea3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0876355
May 26 15:00:52.324585 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-8b699559-b7b9-48da-9273-fcb6c2a687bd req-7518a798-ba4d-43ec-a120-f4fba4554645 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:52.335578 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b0260ca2-35db-467c-88ec-2158dd5330b4 req-98c0cd73-cb6d-4577-b942-85a000f3c964 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0416820
May 26 15:00:52.395328 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-8b699559-b7b9-48da-9273-fcb6c2a687bd req-7518a798-ba4d-43ec-a120-f4fba4554645 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:52.396671 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8b699559-b7b9-48da-9273-fcb6c2a687bd req-7518a798-ba4d-43ec-a120-f4fba4554645 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.1178823
May 26 15:00:52.587904 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85144b49-caf3-477d-bda2-d108e01e9b9a req-41907adf-89fd-46f7-b313-e8a919008066 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:52.589366 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-85144b49-caf3-477d-bda2-d108e01e9b9a req-41907adf-89fd-46f7-b313-e8a919008066 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1012697
May 26 15:00:52.639820 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-85144b49-caf3-477d-bda2-d108e01e9b9a req-7117401e-facc-4808-a996-2aa0679f6493 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0428598
May 26 15:00:52.833887 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-be959f16-9344-4abf-a811-452a39fe36b1 req-ae3c3f7c-c431-431b-a7c5-954e369174ca tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0460887
May 26 15:00:52.875881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84a73efa-9933-4f29-9b21-da05c6c33c69 req-dc99b20e-0184-4345-95ec-c1891e9bdfb9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:52.877338 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84a73efa-9933-4f29-9b21-da05c6c33c69 req-dc99b20e-0184-4345-95ec-c1891e9bdfb9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0902185
May 26 15:00:52.926233 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84a73efa-9933-4f29-9b21-da05c6c33c69 req-44f1044a-7f5a-449d-9eca-8cf2be63d588 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0431771
May 26 15:00:53.121369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:53.201441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f47ed64f-03f9-43d6-b183-9e6b3414cb0a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:53.258723 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea820aa-41dd-407e-9606-b5f78d9699a6 req-4c44a6cf-1b93-4160-9b6c-b0d3c3100f91 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:53.260190 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7ea820aa-41dd-407e-9606-b5f78d9699a6 req-4c44a6cf-1b93-4160-9b6c-b0d3c3100f91 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0816259
May 26 15:00:53.304726 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7ea820aa-41dd-407e-9606-b5f78d9699a6 req-9bfb49f5-a922-4ffa-8649-a4c1eb6641d4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388901
May 26 15:00:53.561524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a195c72-ed5a-44f7-89a0-ee346d30a20f req-892d414d-a7d4-4b84-80b3-ac5a035d5e9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:53.564011 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2a195c72-ed5a-44f7-89a0-ee346d30a20f req-892d414d-a7d4-4b84-80b3-ac5a035d5e9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1171534
May 26 15:00:53.599185 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f3c3f013-3b37-4948-8ffc-92d800d23c8e req-0610e198-1968-447b-aa78-c49fd6737453 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0684240
May 26 15:00:53.620474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fdb3972-8264-4d10-8a3a-20e583ff84dd req-c4354572-970b-4f7a-9d7a-783dc94cc9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:53.623174 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fdb3972-8264-4d10-8a3a-20e583ff84dd req-c4354572-970b-4f7a-9d7a-783dc94cc9c8 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 1099 time: 0.1444552
May 26 15:00:53.627667 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2a195c72-ed5a-44f7-89a0-ee346d30a20f req-616f6bd6-dc12-4d4b-960e-b1e3eb8fa38d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0551696
May 26 15:00:53.669926 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fdb3972-8264-4d10-8a3a-20e583ff84dd req-66411629-a1ca-48b3-bf37-f3a5ff725712 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0389564
May 26 15:00:53.826217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232a752e-acd5-462b-862f-ad140b0ab5d3 req-c9250076-e789-4846-a35e-3f90e9f62795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:53.827662 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-232a752e-acd5-462b-862f-ad140b0ab5d3 req-c9250076-e789-4846-a35e-3f90e9f62795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0806341
May 26 15:00:53.880227 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-232a752e-acd5-462b-862f-ad140b0ab5d3 req-678c0825-67a6-4bf3-ab98-195e73a914ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443358
May 26 15:00:54.034178 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-067049c6-4a70-4356-8fbd-0fb4c1134989 req-691219d1-7b29-49b9-b256-1d4b35354984 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=990431e1-82cb-42b0-a288-949d79e21762 HTTP/1.1" status: 200  len: 210 time: 0.0590353
May 26 15:00:54.041703 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1354d285-16da-4b42-8bc9-ec7a66dfa043 req-8bd24d3d-022b-4a2e-bb9d-8dea3f8e84cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:54.043199 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1354d285-16da-4b42-8bc9-ec7a66dfa043 req-8bd24d3d-022b-4a2e-bb9d-8dea3f8e84cc service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 1099 time: 0.0875902
May 26 15:00:54.059200 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:54.137746 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1354d285-16da-4b42-8bc9-ec7a66dfa043 req-99e002e2-5e6e-46e1-9ac8-c83f9caf3ca7 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0538764
May 26 15:00:54.162148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bd5780d-5673-4b88-be47-a74cd379b5f5 req-72e1afcf-235c-4919-a311-2885e91af402 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:54.163591 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bd5780d-5673-4b88-be47-a74cd379b5f5 req-72e1afcf-235c-4919-a311-2885e91af402 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.1114008
May 26 15:00:54.211463 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bd5780d-5673-4b88-be47-a74cd379b5f5 req-490ad30c-5856-4093-b8a6-bdf873c7d161 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421662
May 26 15:00:54.560075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96e0e999-57bf-4f63-b680-123254d2b6d1 req-2ca66966-0515-4e9a-90a0-67bf5e132b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:54.561521 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-96e0e999-57bf-4f63-b680-123254d2b6d1 req-2ca66966-0515-4e9a-90a0-67bf5e132b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1488645
May 26 15:00:54.610267 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-96e0e999-57bf-4f63-b680-123254d2b6d1 req-f9ad1f50-e2ba-458b-a6ab-6f1336317eec tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0419939
May 26 15:00:54.756303 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 req-23333045-d6b2-4569-904c-369d15b815d0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0471015
May 26 15:00:54.840633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fe346c9-4636-4aa1-9072-37e85907f1d6 req-6f3cea49-7203-473a-9f6f-51f6f62f3bac tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:54.842250 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1fe346c9-4636-4aa1-9072-37e85907f1d6 req-6f3cea49-7203-473a-9f6f-51f6f62f3bac tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0920923
May 26 15:00:54.893282 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1fe346c9-4636-4aa1-9072-37e85907f1d6 req-8304048f-7bd6-4087-8fe0-4a8f9fc2d2e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426095
May 26 15:00:55.083211 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afbcf848-373b-4b4c-a079-41810e6a106f req-2724ac14-b92f-4970-aa10-59cffac397af tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:55.084686 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afbcf848-373b-4b4c-a079-41810e6a106f req-2724ac14-b92f-4970-aa10-59cffac397af tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.0844545
May 26 15:00:55.129808 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afbcf848-373b-4b4c-a079-41810e6a106f req-d177ad37-10e6-432a-aa63-d0f012abee9e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392373
May 26 15:00:55.425366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a94437-700c-4652-9928-864be09e7b1a req-b738b2d9-0815-44b8-a922-7a2421b7d3d0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:55.426987 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-16a94437-700c-4652-9928-864be09e7b1a req-b738b2d9-0815-44b8-a922-7a2421b7d3d0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0909736
May 26 15:00:55.506212 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-16a94437-700c-4652-9928-864be09e7b1a req-818593d4-5c54-4ab4-855c-62e76d1a1e0d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0728953
May 26 15:00:55.608276 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:55.634380 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-3c3a03ab-7d89-49be-b4ef-4f4614a25bab tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:55.635154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-3c3a03ab-7d89-49be-b4ef-4f4614a25bab tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:network {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:55.784118 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-3c3a03ab-7d89-49be-b4ef-4f4614a25bab tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:network {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:55.785314 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-3c3a03ab-7d89-49be-b4ef-4f4614a25bab tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 809 time: 0.3062406
May 26 15:00:55.849835 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-4a6a569a-6c23-478a-a2ae-771755fdf257 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:55.864254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-4a6a569a-6c23-478a-a2ae-771755fdf257 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:55.865141 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-4a6a569a-6c23-478a-a2ae-771755fdf257 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=07c65d1e254f424ebfea8360aa697c34 HTTP/1.1" status: 200  len: 380 time: 0.0688574
May 26 15:00:55.887172 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'port': {'device_id': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'admin_state_up': True, 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'security_groups': ['e529f520-2545-4975-afd4-3361721fae1d']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:56.129127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd70a250-6475-4282-b6f6-600a7ddb9f1c req-217a52c2-7258-4b2d-8c5d-64324dc44c3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:56.130810 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fd70a250-6475-4282-b6f6-600a7ddb9f1c req-217a52c2-7258-4b2d-8c5d-64324dc44c3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0863049
May 26 15:00:56.161091 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a90b2976-78fc-4884-bd21-dd50209b3813 req-2cb49816-f730-450f-b332-53f662638e49 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0703061
May 26 15:00:56.184032 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fd70a250-6475-4282-b6f6-600a7ddb9f1c req-67c1a2e0-426e-4617-90e1-e7f459cf16ce tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0458405
May 26 15:00:56.233529 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:00:56.244437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:00:56.318022 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Made reservation on behalf of 07c65d1e254f424ebfea8360aa697c34 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:00:56.321447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:56.503065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 req-8bd3574b-9773-4836-9cf8-e8cb35c0eebc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:56.504540 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 req-8bd3574b-9773-4836-9cf8-e8cb35c0eebc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.2262239
May 26 15:00:56.561386 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Allocated IP 172.20.0.9 (e30d7c90-8779-49cd-96d8-5c4ae28c55f9/f8df0d21-cfe4-4e67-913c-771912dae169/24388d3c-fd02-41f5-996a-da7452902c2b) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:00:56.572482 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 req-2aa8620e-3e1a-4a6f-9605-37aeda6a93dc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616076
May 26 15:00:56.706032 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4856b62-ecce-488c-9125-fa0062ac9c9d req-5bda5642-57ad-4b44-b129-dc0ec2547d23 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:56.707673 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d4856b62-ecce-488c-9125-fa0062ac9c9d req-5bda5642-57ad-4b44-b129-dc0ec2547d23 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0869889
May 26 15:00:56.761252 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d4856b62-ecce-488c-9125-fa0062ac9c9d req-1b293744-9e43-498f-a915-727c19f40a14 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464728
May 26 15:00:56.782429 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:56.805807 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Transition to ACTIVE for port object 24388d3c-fd02-41f5-996a-da7452902c2b will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:56.887654 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:56.894060 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:56.966155 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:00:56.969418 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:00:56.973346 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:00:57.004586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:00:57.024825 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.025191 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.025833 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.026194 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.026549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.026891 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.027237 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.027578 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.027922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.028263 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.028603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.028941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:00:57.034669 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:00:57.052657 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:57.053266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:57.156347 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-18c54551-c1d2-4ef5-9e1d-528da8680c44 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2827170
May 26 15:00:57.229812 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-87fed6d0-d06d-4db7-bedd-f46558bff7f6 None None] Provisioning for port 24388d3c-fd02-41f5-996a-da7452902c2b completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:00:57.236541 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-87fed6d0-d06d-4db7-bedd-f46558bff7f6 None None] Provisioning complete for port 24388d3c-fd02-41f5-996a-da7452902c2b triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:00:57.236971 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-87fed6d0-d06d-4db7-bedd-f46558bff7f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:57.300573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-87fed6d0-d06d-4db7-bedd-f46558bff7f6 None None] Port 24388d3c-fd02-41f5-996a-da7452902c2b cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:00:57.362054 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59850aca-97ca-4a53-9247-c4761654bfd7 req-a728383f-82fa-4a33-855a-51a3369305c2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:57.362749 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-59850aca-97ca-4a53-9247-c4761654bfd7 req-a728383f-82fa-4a33-855a-51a3369305c2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:00:57.419879 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-019916c1-bd17-4e7d-9818-4a9b2eae8055 req-a1a0861a-36bb-4813-9505-462aa881922b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:57.421323 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-019916c1-bd17-4e7d-9818-4a9b2eae8055 req-a1a0861a-36bb-4813-9505-462aa881922b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0823536
May 26 15:00:57.441446 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-59850aca-97ca-4a53-9247-c4761654bfd7 req-a728383f-82fa-4a33-855a-51a3369305c2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:00:57.442680 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-59850aca-97ca-4a53-9247-c4761654bfd7 req-a728383f-82fa-4a33-855a-51a3369305c2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 931 time: 0.1741867
May 26 15:00:57.470839 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-019916c1-bd17-4e7d-9818-4a9b2eae8055 req-513d8e49-0064-43fa-ae64-26d469257d6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0431476
May 26 15:00:57.488580 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-59850aca-97ca-4a53-9247-c4761654bfd7 req-938e77bc-1f84-4245-8d41-fceae27be159 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400903
May 26 15:00:58.662342 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1035f48a-4f31-4111-ba46-791d3d643ec7 req-b91fe609-3341-421b-a351-f11a6f621719 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:58.663812 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1035f48a-4f31-4111-ba46-791d3d643ec7 req-b91fe609-3341-421b-a351-f11a6f621719 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0807407
May 26 15:00:58.678314 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 req-ef0bd61a-3b51-47b5-b865-156212a95e95 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:58.679779 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 req-ef0bd61a-3b51-47b5-b865-156212a95e95 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 931 time: 0.0809982
May 26 15:00:58.709205 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1035f48a-4f31-4111-ba46-791d3d643ec7 req-f5fcc78a-83e2-472e-9382-89ca6216ecd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397382
May 26 15:00:58.729439 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 req-58754508-3f1e-4d2a-a6a3-dc94028f3128 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437856
May 26 15:00:59.281250 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Request body: {'port': {'device_id': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:00:59.349504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:59.391148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:59.739987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 24388d3c-fd02-41f5-996a-da7452902c2b {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:00:59.747611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:59.764051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Transition to ACTIVE for port object 24388d3c-fd02-41f5-996a-da7452902c2b will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:00:59.841258 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:00:59.848980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-29dc1659-b957-4ca3-b845-b01ca76abf05 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:00:59.921335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273ac3fe-adbe-4108-aa44-92b0559a562c req-461f8d45-6285-4398-9f36-ff728ad5ea9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:00:59.923444 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-273ac3fe-adbe-4108-aa44-92b0559a562c req-461f8d45-6285-4398-9f36-ff728ad5ea9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0908689
May 26 15:01:00.031622 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-273ac3fe-adbe-4108-aa44-92b0559a562c req-c954228c-c82e-48a6-8934-c1bb7a2f3305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0955362
May 26 15:01:00.071197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:00.086567 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:00.272949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 req-69a701b4-c627-440f-985c-534ec6456afb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:00.274477 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 req-69a701b4-c627-440f-985c-534ec6456afb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.3954463
May 26 15:01:00.278858 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Attempting to bind port 24388d3c-fd02-41f5-996a-da7452902c2b on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:01:00.279187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Attempting to bind port 24388d3c-fd02-41f5-996a-da7452902c2b by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:01:00.279512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Attempting to bind port 24388d3c-fd02-41f5-996a-da7452902c2b on network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:01:00.298080 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Port 24388d3c-fd02-41f5-996a-da7452902c2b on network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:01:00.298401 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Attempting to bind port 24388d3c-fd02-41f5-996a-da7452902c2b on network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:01:00.307651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 0, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:01:00.307920 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Checking segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:01:00.308294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Bound using segment: {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:01:00.308729 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Bound port: 24388d3c-fd02-41f5-996a-da7452902c2b, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd854f15e-4f6e-4459-9574-2252ec12295e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:01:00.309067 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:00.387308 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 req-63e07085-2c3b-4198-b584-db036a7f1d1c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1031384
May 26 15:01:00.422703 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:01:00.425858 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:01:00.498283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:00.498283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:00.553890 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:00.554494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:00.555863 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] 10.222.0.32 "PUT /v2.0/ports/24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 1093 time: 1.2792015
May 26 15:01:00.556348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:00.580389 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:00.592075 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:00.612602 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'status': 'completed', 'code': 200}
May 26 15:01:00.737268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-c676142f-26f5-4281-9da5-e40ed83c9930 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:00.740367 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-c676142f-26f5-4281-9da5-e40ed83c9930 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1096 time: 0.0960155
May 26 15:01:00.918362 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-4645ce8a-8cc3-4dcf-8b77-258ec3b91fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:00.920140 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-4645ce8a-8cc3-4dcf-8b77-258ec3b91fd0 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=07c65d1e254f424ebfea8360aa697c34&shared=False HTTP/1.1" status: 200  len: 911 time: 0.1694171
May 26 15:01:00.962327 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-28d1d238-f6ab-4537-9c35-b2d6cd28e926 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1085606
May 26 15:01:01.078972 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-acadb36e-ff7a-4f03-b390-d6a99d383015 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.080340 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-acadb36e-ff7a-4f03-b390-d6a99d383015 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1534843
May 26 15:01:01.146567 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-a3acdbd3-b9b8-413d-b53d-c1d932922994 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.148030 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-a3acdbd3-b9b8-413d-b53d-c1d932922994 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 1099 time: 0.1424646
May 26 15:01:01.172584 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 req-7b189b7c-8a7c-445a-bcdd-79b33180a52a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.179873 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 req-7b189b7c-8a7c-445a-bcdd-79b33180a52a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.1320026
May 26 15:01:01.199679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-8d0cf019-70b8-4745-bf72-8f572eaf05d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.202912 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-8d0cf019-70b8-4745-bf72-8f572eaf05d4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1096 time: 0.0773768
May 26 15:01:01.296504 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-21b3b208-c5de-4b7c-b8d4-e4c4a3c51cb0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 217 time: 0.0818613
May 26 15:01:01.310120 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 req-e30a709b-ecd8-4f6e-8a6a-c4d3d3db9b0a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1298015
May 26 15:01:01.378923 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-a1370d59-1bc0-4f58-8060-934a5e791aba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.380625 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-a1370d59-1bc0-4f58-8060-934a5e791aba service neutron] 10.222.0.32 "GET /v2.0/networks?id=bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 200  len: 920 time: 0.1856337
May 26 15:01:01.386673 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-25495ea9-4cab-45dc-aab8-5f7b5f0b5d8a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.388123 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-25495ea9-4cab-45dc-aab8-5f7b5f0b5d8a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0692217
May 26 15:01:01.480223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-75fe048a-1297-4b12-8f12-8815bc57014c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.481638 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-75fe048a-1297-4b12-8f12-8815bc57014c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0853968
May 26 15:01:01.485928 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-c751d76a-9267-4a93-ac20-579de218802a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 200  len: 217 time: 0.0980127
May 26 15:01:01.612348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-ec280f79-5fe3-4b0d-9c0d-3d483c47ceb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.614481 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-ec280f79-5fe3-4b0d-9c0d-3d483c47ceb7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 200  len: 858 time: 0.1126940
May 26 15:01:01.633584 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-9e989ddf-24a3-4459-8e58-368a7e94c925 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1363945
May 26 15:01:01.635975 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb374499-7f0f-46d7-8178-405f728bdb5d req-280195fe-ad32-49be-9248-726bf1123f4d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:01.637386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eb374499-7f0f-46d7-8178-405f728bdb5d req-280195fe-ad32-49be-9248-726bf1123f4d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.1984880
May 26 15:01:01.690341 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-01cbc3b8-cf67-4e98-8b09-5bc367a9975b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=bc70d705-69d9-4bd7-ad11-798aa6a60676&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0519032
May 26 15:01:01.778445 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0deb24f6-2b74-402c-a7f4-1592f834f5fd req-b46613f6-1af5-4edb-bf03-4f4778e6fdaf service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1313725
May 26 15:01:01.816570 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eb374499-7f0f-46d7-8178-405f728bdb5d req-b0ec9c25-54ad-47b3-bfa1-a62ce18c6f7f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1252317
May 26 15:01:01.868507 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-f7910c0d-65a1-4b14-9341-32dfc4c6886c service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1627679
May 26 15:01:02.121378 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a7d1a16-8612-4b24-85db-9931478a4cec req-b3c33e76-3eae-4b0b-a6b7-1a23af80f571 service neutron] 10.222.0.32 "GET /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2357159
May 26 15:01:02.131959 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e09799-894b-4a7d-a226-bfd6f087bee2 req-8ad8cebf-d0bc-45cf-a1cf-b89fe54366cc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:02.133365 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f0e09799-894b-4a7d-a226-bfd6f087bee2 req-8ad8cebf-d0bc-45cf-a1cf-b89fe54366cc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1755152
May 26 15:01:02.184874 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f0e09799-894b-4a7d-a226-bfd6f087bee2 req-d6f340af-f900-404c-b45c-1c8a901b8c15 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0454915
May 26 15:01:02.516645 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad646721-b526-4098-8684-d5d8b1634de8 req-555ac945-41fd-4325-b634-ac8aa0cb38d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:02.516645 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad646721-b526-4098-8684-d5d8b1634de8 req-555ac945-41fd-4325-b634-ac8aa0cb38d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0894668
May 26 15:01:02.554533 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad646721-b526-4098-8684-d5d8b1634de8 req-163b5728-3a98-4fd0-aaf0-3e3bfbfb9eeb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/security-groups?id=0fe11b4a-86c5-48f8-bf9f-1699f6b08150&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0433035
May 26 15:01:03.004566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-4c7ecd6a-0c2c-4080-9b3d-95b69a595a3e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:03.006323 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-4c7ecd6a-0c2c-4080-9b3d-95b69a595a3e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 946 time: 0.0898178
May 26 15:01:03.013339 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 req-1aef02fb-7511-4b21-b5eb-132d8cd4bdf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:03.014897 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 req-1aef02fb-7511-4b21-b5eb-132d8cd4bdf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 944 time: 0.0845563
May 26 15:01:03.060225 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 req-5182aa51-a3cc-464b-b581-a3b9cfebfac8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393541
May 26 15:01:03.142629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Deleting port e2b86960-bb59-4f27-9951-ec442358a17d {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:03.143470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.279776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] For port e2b86960-bb59-4f27-9951-ec442358a17d, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e2b86960-bb59-4f27-9951-ec442358a17d,segment=NetworkSegment(68a5ec6b-7a18-4714-970b-4f682bf72674),segment_id=68a5ec6b-7a18-4714-970b-4f682bf72674)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:03.280332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.329204 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:01:03.412355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling delete_port for e2b86960-bb59-4f27-9951-ec442358a17d owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:03.467299 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:03.481429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'e948d481-711f-45b8-8deb-08b7658709e7', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'e948d481-711f-45b8-8deb-08b7658709e7', 'mac_address': 'fa:16:3e:e5:7c:d1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:01:03.514589 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5882f641-c29a-4f33-b674-d8978eb3cb34 req-f43e8968-9983-4b54-86b5-8c4ebb5235d0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:03.516611 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5882f641-c29a-4f33-b674-d8978eb3cb34 req-f43e8968-9983-4b54-86b5-8c4ebb5235d0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1691401
May 26 15:01:03.542612 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.574046 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:01:03.595947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:03.643917 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5882f641-c29a-4f33-b674-d8978eb3cb34 req-07baae14-79b6-44f7-854d-0eb19a571b2d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1107898
May 26 15:01:03.675368 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.680160 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:03.721359 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.727497 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3b39a1d4-8a1a-4903-b67b-501e28f48b5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:03.729234 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-af8b1097-bd57-4458-b388-642f7a47b141 req-7415f1a4-ddbf-4a1a-abb1-2ed9c9223830 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0414746
May 26 15:01:03.738775 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e2b86960-bb59-4f27-9951-ec442358a17d'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:03.773047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Pushing event deleted for resources: {'Port': ['ID=e2b86960-bb59-4f27-9951-ec442358a17d,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:03.783085 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=9']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:03.783721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.783960 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.784317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.784773 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.784999 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.785340 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.785703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.786048 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.786390 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.786724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.787056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.787756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.790387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.790720 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.791051 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.791372 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.791798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.791999 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.792318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.792630 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.792949 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.793257 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.793752 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.793905 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:01:03.797682 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:03.815121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:03.862344 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] No DVR routers for this DVR port e2b86960-bb59-4f27-9951-ec442358a17d on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:03.864701 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:03.867152 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'name': 'network-vif-deleted', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:03.914838 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e4e2075-5a0f-4e15-892d-e4b5eb5b8807', 'name': 'network-vif-deleted', 'tag': 'e2b86960-bb59-4f27-9951-ec442358a17d', 'status': 'completed', 'code': 200}
May 26 15:01:03.939631 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4a74b8ed-d513-4f32-81f8-fb319e53880b req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.32 "DELETE /v2.0/ports/e2b86960-bb59-4f27-9951-ec442358a17d HTTP/1.1" status: 204  len: 173 time: 0.9274287
May 26 15:01:04.252237 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9d45ab1-032a-4745-b774-6ba0c6704526 req-fca4c487-e52a-4e52-9ba3-7af989499555 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:04.253750 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9d45ab1-032a-4745-b774-6ba0c6704526 req-fca4c487-e52a-4e52-9ba3-7af989499555 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.0830395
May 26 15:01:04.289894 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:01:04.299969 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d9d45ab1-032a-4745-b774-6ba0c6704526 req-44a8b07e-0c62-4776-8cf3-22de7926b6f2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402851
May 26 15:01:04.839973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85861492-e578-4ece-95f3-a1ea834c525b req-b123cf6c-fb58-44da-9c7d-fe790f0dd5ce tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:04.842240 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-85861492-e578-4ece-95f3-a1ea834c525b req-b123cf6c-fb58-44da-9c7d-fe790f0dd5ce tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0865836
May 26 15:01:04.882085 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-86839551-6118-49ca-9cb5-26691cad610f req-ec13aa03-7780-4375-98a8-d662cc0f5ff2 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.0421376
May 26 15:01:04.888317 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-85861492-e578-4ece-95f3-a1ea834c525b req-2148815c-5c0d-4997-a740-f2ea4d27101c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396619
May 26 15:01:05.490617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1b9276a-27e9-4879-a598-6849517f35bc req-f4978b1d-6a07-424b-a262-7801b4b7ddf9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:05.492078 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c1b9276a-27e9-4879-a598-6849517f35bc req-f4978b1d-6a07-424b-a262-7801b4b7ddf9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.0833683
May 26 15:01:05.536633 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c1b9276a-27e9-4879-a598-6849517f35bc req-590f926a-e79d-45b7-9339-c8f3d5921a0c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387366
May 26 15:01:06.035824 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 req-4c87c53f-16e1-4972-af4b-b06b6bbccf30 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Synchronizing usage tracker for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:06.074476 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f req-682e23c5-ad51-4bf6-95ad-b42ea06b1ab3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:06.075818 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f req-682e23c5-ad51-4bf6-95ad-b42ea06b1ab3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0796323
May 26 15:01:06.104213 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 req-4c87c53f-16e1-4972-af4b-b06b6bbccf30 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Unset dirty status for tenant:dffd269c3a344d36b77ebb04d0c412e3 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:06.105386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 req-4c87c53f-16e1-4972-af4b-b06b6bbccf30 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.1154015
May 26 15:01:06.126615 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f req-7ff021aa-8ad5-4194-9b00-45bb3d15a420 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445397
May 26 15:01:06.727662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a95942-d8cf-4e16-ac19-2c763ad0910e req-63d0d476-97c5-4c5f-a620-69efb0859831 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:06.729104 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-67a95942-d8cf-4e16-ac19-2c763ad0910e req-63d0d476-97c5-4c5f-a620-69efb0859831 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.0800319
May 26 15:01:06.774741 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-67a95942-d8cf-4e16-ac19-2c763ad0910e req-c9783304-2e0f-4e3b-a56e-7180d6bcb46e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398130
May 26 15:01:06.976183 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e948d481-711f-45b8-8deb-08b7658709e7'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:07.319144 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f115bb5b-276c-43d6-88c1-113770789eb8 req-04f01895-f12c-4a94-afc5-64fa5af108d5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:07.320673 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f115bb5b-276c-43d6-88c1-113770789eb8 req-04f01895-f12c-4a94-afc5-64fa5af108d5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0889566
May 26 15:01:07.351123 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-37cbe785-0f47-4fb1-b640-819bd3a187f1 req-72ff041d-25ed-43b2-a4b2-b77e160c6451 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /v2.0/ports?device_id=8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 HTTP/1.1" status: 200  len: 210 time: 0.1246517
May 26 15:01:07.369940 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f115bb5b-276c-43d6-88c1-113770789eb8 req-ce1e6fef-4252-4d5c-881d-566ac4deace3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0433416
May 26 15:01:07.723807 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-aaa5aee8-fdd0-44e7-9f0e-542a93742060 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:07.725176 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-aaa5aee8-fdd0-44e7-9f0e-542a93742060 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/networks?id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298 HTTP/1.1" status: 200  len: 814 time: 0.1437669
May 26 15:01:07.740375 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-ab4a06d7-8dc2-4429-969f-545d1e533d3b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/quotas/5b729993a1944061bb0a708877c95a5c HTTP/1.1" status: 200  len: 375 time: 0.0094976
May 26 15:01:07.786825 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-c848fff0-f629-4118-a00f-5c0ca6d287bc tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0415030
May 26 15:01:07.920336 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-81073858-de99-4108-9d5f-794a1de13eba service neutron] 10.222.0.81 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1270165
May 26 15:01:07.984275 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168f9373-1d45-49c1-a609-f9f6b093d276 req-d9166aa6-602e-4434-8759-cff52f48a955 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:07.986875 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-168f9373-1d45-49c1-a609-f9f6b093d276 req-d9166aa6-602e-4434-8759-cff52f48a955 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 945 time: 0.0960376
May 26 15:01:08.036336 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-168f9373-1d45-49c1-a609-f9f6b093d276 req-0674d685-9b20-4b7e-83f9-dad8ba972fdf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435052
May 26 15:01:08.068270 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-202cd583-ebc7-4951-84e7-e38dd6ebc0c0 service neutron] 10.222.0.81 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1410046
May 26 15:01:08.377400 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7c9c4e77-cd8c-40e0-9d48-5f6bb0b5e141 req-bcb54f77-2fbf-4f2a-b340-d85dacab6951 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0480809
May 26 15:01:08.643131 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 req-ce3f83dd-55d0-429c-9275-7565ecf51c14 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:08.644683 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 req-ce3f83dd-55d0-429c-9275-7565ecf51c14 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0846426
May 26 15:01:08.694147 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 req-69a93883-dc22-48b3-8f50-0c492242513d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0436137
May 26 15:01:08.724939 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:01:08.768750 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 req-be3f6036-ce03-45b6-b3f9-ac6304c9fbf4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:08.770425 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 req-be3f6036-ce03-45b6-b3f9-ac6304c9fbf4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1743526
May 26 15:01:08.805157 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port e948d481-711f-45b8-8deb-08b7658709e7 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:01:08.805557 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:08.819124 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 req-6aab1bc1-f6c8-44e7-96a9-442b44dd7738 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0421956
May 26 15:01:08.925148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:08.978481 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:08.988720 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:09.025895 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'code': 200}
May 26 15:01:09.052489 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:09.054500 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e2b86960-bb59-4f27-9951-ec442358a17d no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:09.092116 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:09.147214 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: e2b86960-bb59-4f27-9951-ec442358a17d {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:09.147620 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e2b86960-bb59-4f27-9951-ec442358a17d not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:09.166023 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=10']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:09.169109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:09.259752 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84667d03-9980-4773-9626-fcf89d75cc32 req-282bece2-e7e7-4716-afb4-2085399962ed tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:09.261486 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84667d03-9980-4773-9626-fcf89d75cc32 req-282bece2-e7e7-4716-afb4-2085399962ed tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0899253
May 26 15:01:09.311727 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-84667d03-9980-4773-9626-fcf89d75cc32 req-d04e23d3-c8e3-4f89-b3fd-9132c31c5571 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0438435
May 26 15:01:09.529839 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-790adf85-86a0-4b62-9787-4d96e05e0662 req-04ac6a01-1911-44aa-9b8c-bff8fa43ad6e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0485833
May 26 15:01:09.946210 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99f00f83-067e-4d0c-88bf-01dc10671159 req-c7ab8dad-bb57-4f5c-96b2-998c6b7ebcaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:09.948448 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-99f00f83-067e-4d0c-88bf-01dc10671159 req-c7ab8dad-bb57-4f5c-96b2-998c6b7ebcaf service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1100 time: 0.1007559
May 26 15:01:09.955799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 req-d3a93768-263e-426e-b151-798c990282bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:09.957222 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 req-d3a93768-263e-426e-b151-798c990282bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1532199
May 26 15:01:10.025032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 req-1e77a926-9975-40c3-82de-5d2afba21376 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:10.027023 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 req-1e77a926-9975-40c3-82de-5d2afba21376 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1026199
May 26 15:01:10.029879 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-99f00f83-067e-4d0c-88bf-01dc10671159 req-19856d62-8e4e-4466-9221-6b49f779c2e5 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0715828
May 26 15:01:10.041144 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 req-0b7e0f3b-f86c-4c25-b4e4-ca2a5c75e9f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0677655
May 26 15:01:10.083457 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 req-7b1c9e93-dbd8-48ea-85a9-a74550c902dd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490584
May 26 15:01:10.560079 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-983392ad-8b0f-4189-a526-e4a45ba4be71 req-a7e03039-0c4a-48a0-b80d-fd5076fd76ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:10.561570 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-983392ad-8b0f-4189-a526-e4a45ba4be71 req-a7e03039-0c4a-48a0-b80d-fd5076fd76ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0897093
May 26 15:01:10.612967 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-983392ad-8b0f-4189-a526-e4a45ba4be71 req-17be011f-7716-4046-837d-916b521f20a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456326
May 26 15:01:10.767770 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-81fe7aa4-df4b-40c3-8264-f4246910da74 req-d036cef5-e9b2-432c-bc38-f918ec365076 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0491762
May 26 15:01:10.817099 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-659867d7-90ce-4df7-8fbb-10c090979993 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:10.818523 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-659867d7-90ce-4df7-8fbb-10c090979993 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "GET /v2.0/networks?id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298 HTTP/1.1" status: 200  len: 814 time: 0.2023041
May 26 15:01:11.219917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc18792-5c24-4566-9c4a-021da6fbbc31 req-9a0d3079-8532-4a35-9b72-6895281cb478 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:11.221568 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2fc18792-5c24-4566-9c4a-021da6fbbc31 req-9a0d3079-8532-4a35-9b72-6895281cb478 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0841691
May 26 15:01:11.265918 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2fc18792-5c24-4566-9c4a-021da6fbbc31 req-a60a79de-8ef2-4714-baef-3e872afa3f69 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386853
May 26 15:01:11.274975 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 req-820ee628-5680-48ff-bace-8e4ac41340dd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:11.276709 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 req-820ee628-5680-48ff-bace-8e4ac41340dd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0834415
May 26 15:01:11.322381 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 req-c9c47a4f-25c8-4cc8-b6db-7e70c701e440 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0393431
May 26 15:01:11.808229 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 req-f18ef0a2-370c-4339-bc28-3cbe2329d58c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:11.809732 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 req-f18ef0a2-370c-4339-bc28-3cbe2329d58c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0854349
May 26 15:01:11.855736 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 req-555abf4e-dfe1-488a-abd6-ca5aa45d7fa5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395882
May 26 15:01:11.895273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:01:11.927725 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 req-0dd1b6dc-0398-40be-b93e-ce6f5dd66dd9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0427203
May 26 15:01:12.028365 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:12.041177 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '24388d3c-fd02-41f5-996a-da7452902c2b', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'mac_address': 'fa:16:3e:cc:eb:6d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1218, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:01:12.095802 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:12.116302 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24388d3c-fd02-41f5-996a-da7452902c2b {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:01:12.135199 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:12.218424 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:12.220406 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:12.288105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:12.291071 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:12.452182 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 req-c6de00eb-a6a1-4a7f-af5e-a1362c8cd2e6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:12.453655 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 req-c6de00eb-a6a1-4a7f-af5e-a1362c8cd2e6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.0844491
May 26 15:01:12.499645 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 req-d4dd0ff6-9144-4d40-b4f6-e86c9d8acde0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394912
May 26 15:01:12.512966 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 req-fd536f47-62d8-4455-859e-9a54e6bf4d00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:12.517376 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 req-fd536f47-62d8-4455-859e-9a54e6bf4d00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0902514
May 26 15:01:12.559564 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 req-0e492692-53d1-4eb8-b3bd-bce555ed3b42 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0388536
May 26 15:01:13.053515 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 req-bfb75a4e-147a-4936-928b-929eea7be5d8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:13.055029 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 req-bfb75a4e-147a-4936-928b-929eea7be5d8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0889773
May 26 15:01:13.075480 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-08b1ad8e-2e2a-4f88-ad94-69406298288a req-b539aa8f-7273-4f9f-9d4b-2df3bb8a99a1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0427403
May 26 15:01:13.103484 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 req-4f96d563-67d1-43f0-8a03-45ebe23dfe44 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0428572
May 26 15:01:13.687893 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 req-0a67f15a-d38c-43ae-a5e5-f72f049d99cb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:13.689519 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 req-0a67f15a-d38c-43ae-a5e5-f72f049d99cb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.0809274
May 26 15:01:13.737568 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 req-f8e17641-bb72-4672-a9f5-86dbf73ac055 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422986
May 26 15:01:13.752655 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c35ee8-05ec-4e0c-9936-9356753e2a8d req-e4dbe86f-39af-47f7-9b50-3afbcacc8466 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:13.754163 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43c35ee8-05ec-4e0c-9936-9356753e2a8d req-e4dbe86f-39af-47f7-9b50-3afbcacc8466 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.0851250
May 26 15:01:13.801227 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-43c35ee8-05ec-4e0c-9936-9356753e2a8d req-55bfdc0c-1a63-4e23-8b89-8f5ac27eac6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0414557
May 26 15:01:13.964332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Request body: {'port': {'device_id': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298', 'admin_state_up': True, 'tenant_id': '5b729993a1944061bb0a708877c95a5c'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:01:14.105733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:01:14.120639 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:01:14.190241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Made reservation on behalf of 5b729993a1944061bb0a708877c95a5c for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:01:14.194686 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:14.260568 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bb3b5178-8714-4398-942b-f976eeee5a5a req-8b160d50-d0e4-4033-bd8f-f69ec940b45e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0727625
May 26 15:01:14.382587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Allocated IP 172.20.0.3 (9f5bc9eb-1964-454a-a177-4bdcfc4e0298/bdad3913-e712-409a-9b8b-ccdccd8ad915/5ae9ad7a-f33d-4cca-8a87-1bb5070abea8) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:01:14.627940 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['24388d3c-fd02-41f5-996a-da7452902c2b'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:14.633488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e316221b-1193-4e6f-900d-ad3093e87335 req-627fe0fc-8939-4eda-b968-bb3806978f1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:14.634992 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e316221b-1193-4e6f-900d-ad3093e87335 req-627fe0fc-8939-4eda-b968-bb3806978f1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.2134428
May 26 15:01:14.750626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:14.797518 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e316221b-1193-4e6f-900d-ad3093e87335 req-4e7fd97f-3b6e-4a14-89bc-7eec1ad6b91e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1554801
May 26 15:01:14.895327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:14.903694 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4b76ae8d-3795-4b2e-9e36-482bc7b8eb17 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:15.004847 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0266994b-9872-44c7-8c18-bc63ee59c6a0 req-016e0abb-7541-4f69-b96e-6a45b5fb1bc1 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:15.006541 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0266994b-9872-44c7-8c18-bc63ee59c6a0 req-016e0abb-7541-4f69-b96e-6a45b5fb1bc1 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.0954614
May 26 15:01:15.029799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:01:15.037164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:01:15.042009 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:01:15.068014 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0266994b-9872-44c7-8c18-bc63ee59c6a0 req-da3f56ee-696b-4c42-8ae2-f479047b59e6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0546424
May 26 15:01:15.108572 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Pushing event updated for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:15.112831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:15.140640 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:15.141233 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:15.176818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-465ae525-4516-45f3-a3a3-d627034ca447 req-72414ecf-911a-41e2-b180-6c34327a4b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:15.178278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-465ae525-4516-45f3-a3a3-d627034ca447 req-72414ecf-911a-41e2-b180-6c34327a4b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.2229724
May 26 15:01:15.225853 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-465ae525-4516-45f3-a3a3-d627034ca447 req-5e44ad9b-0e8c-4326-b63a-579240093198 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0418386
May 26 15:01:15.267815 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3045094
May 26 15:01:15.296680 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Request body: {'port': {'device_id': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:01:15.442469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:15.505348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a req-b61eaad8-dcc8-405a-bf3b-c4d13063a87e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:15.507272 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a req-b61eaad8-dcc8-405a-bf3b-c4d13063a87e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 931 time: 0.1212790
May 26 15:01:15.572944 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a req-4256ee0e-f1ab-4ef3-9ff9-ce7672301bd9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0597775
May 26 15:01:15.951891 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-f907e98d-52ba-48e7-b7b5-bfabe3b7a29c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:15.951891 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-f907e98d-52ba-48e7-b7b5-bfabe3b7a29c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.1995544
May 26 15:01:16.091715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:01:16.102582 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:16.125768 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Transition to ACTIVE for port object 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:01:16.171105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13d2fbe-aac1-4542-b193-c8d36b941887 req-eaf91e7d-749a-45b3-b568-4100314c6530 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:16.175573 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e13d2fbe-aac1-4542-b193-c8d36b941887 req-eaf91e7d-749a-45b3-b568-4100314c6530 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.1559212
May 26 15:01:16.221824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Deleting port 0cdf2872-b922-4d87-8260-bb3c5b2a449b {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:16.222947 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:16.230092 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:16.243338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bf5ab4a2-2dd6-49f2-9019-ba255cd70d8b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:16.475680 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e13d2fbe-aac1-4542-b193-c8d36b941887 req-c3e91ceb-d51b-4948-ba41-17992e5d7281 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2938571
May 26 15:01:16.654717 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] For port 0cdf2872-b922-4d87-8260-bb3c5b2a449b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=0cdf2872-b922-4d87-8260-bb3c5b2a449b,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:16.655354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:16.664393 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Pushing event updated for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:16.678259 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.427s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:16.775590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Attempting to bind port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:01:16.775919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Attempting to bind port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:01:16.776272 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Attempting to bind port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:01:16.790317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:01:16.790317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Attempting to bind port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 on network 9f5bc9eb-1964-454a-a177-4bdcfc4e0298 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:01:16.797766 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 0, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:01:16.798779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Checking segment: {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:01:16.799169 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Bound using segment: {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:01:16.799612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Bound port: 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '324ba4e6-313b-4b92-81fd-29df319c25e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1220, 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:01:16.800006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:16.800599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling delete_port for 0cdf2872-b922-4d87-8260-bb3c5b2a449b owned by compute:nova {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:16.828095 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:01:16.996509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 req-5e3bd9ae-ccaa-4cbf-bebf-346eec038afb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.000603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f75315e-b82f-4bcb-80ee-25e912a954cd req-2e537020-0591-4a55-9182-82723fa71f9c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.000603 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8f75315e-b82f-4bcb-80ee-25e912a954cd req-2e537020-0591-4a55-9182-82723fa71f9c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.5556533
May 26 15:01:17.023545 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 req-5e3bd9ae-ccaa-4cbf-bebf-346eec038afb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 946 time: 0.3710797
May 26 15:01:17.042988 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:01:17.058676 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 24388d3c-fd02-41f5-996a-da7452902c2b completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:01:17.067097 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 24388d3c-fd02-41f5-996a-da7452902c2b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:01:17.067792 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.079883 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.084719 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:01:17.104045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-38b78552-b582-45ef-b650-fe74e9d364f7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:17.108988 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 req-957e60c4-312c-419b-a668-f6e9c10285b9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0871234
May 26 15:01:17.155862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.161715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:17.164047 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['be847840-0dc2-4457-bb7b-594e083f4912'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:17.231940 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Pushing event deleted for resources: {'Port': ['ID=0cdf2872-b922-4d87-8260-bb3c5b2a449b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:17.242550 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8f75315e-b82f-4bcb-80ee-25e912a954cd req-5dcd2321-9548-43c4-9055-16eb565eae66 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2329264
May 26 15:01:17.271807 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:17.278117 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Pushing event updated for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:17.287145 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:17.292878 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.294036 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.299897 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] 10.222.0.32 "PUT /v2.0/ports/5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 HTTP/1.1" status: 200  len: 1093 time: 2.0084326
May 26 15:01:17.299897 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:17.364336 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] No DVR routers for this DVR port 0cdf2872-b922-4d87-8260-bb3c5b2a449b on host hv-cinder-78414 {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:17.370457 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.374451 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'name': 'network-vif-deleted', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:17.406758 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8', 'status': 'completed', 'code': 200}
May 26 15:01:17.461860 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'acc03344-b5df-4277-82e4-c9b3228969ca', 'name': 'network-vif-deleted', 'tag': '0cdf2872-b922-4d87-8260-bb3c5b2a449b', 'status': 'completed', 'code': 200}
May 26 15:01:17.473750 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.483812 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 req-80a9b73e-a02a-486b-b62c-4f0aef8866d6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "DELETE /v2.0/ports/0cdf2872-b922-4d87-8260-bb3c5b2a449b HTTP/1.1" status: 204  len: 173 time: 1.5205445
May 26 15:01:17.537888 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:17.562155 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:17.569347 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-15d52803-e056-44e4-989f-8e559b8cd9ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.570894 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-15d52803-e056-44e4-989f-8e559b8cd9ca service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 1096 time: 0.1354551
May 26 15:01:17.615754 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-034e190e-4b77-4b7c-b3dd-327e15a24d25 req-6c81ba4c-ad09-42cc-bb13-ee38688d426c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.615754 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-034e190e-4b77-4b7c-b3dd-327e15a24d25 req-6c81ba4c-ad09-42cc-bb13-ee38688d426c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:17.691448 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:17.693411 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:17.779169 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-807cefb6-558a-4864-bb44-fce988781810 req-a885b0e3-eb81-4bc9-bf1a-cf8fc476a843 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.784617 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-807cefb6-558a-4864-bb44-fce988781810 req-a885b0e3-eb81-4bc9-bf1a-cf8fc476a843 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.1359260
May 26 15:01:17.809458 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:17.822798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:17.858777 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-807cefb6-558a-4864-bb44-fce988781810 req-c1708167-0563-443b-8f98-26e22abd8f49 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0677788
May 26 15:01:17.886646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-cd9cc754-d706-4291-95b2-3001c0cf7c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:17.888038 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-cd9cc754-d706-4291-95b2-3001c0cf7c05 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=5b729993a1944061bb0a708877c95a5c&shared=False HTTP/1.1" status: 200  len: 916 time: 0.3037286
May 26 15:01:17.950945 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'code': 200}
May 26 15:01:18.014259 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-034e190e-4b77-4b7c-b3dd-327e15a24d25 req-6c81ba4c-ad09-42cc-bb13-ee38688d426c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:18.021532 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-034e190e-4b77-4b7c-b3dd-327e15a24d25 req-6c81ba4c-ad09-42cc-bb13-ee38688d426c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 943 time: 0.7000387
May 26 15:01:18.092768 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-bef749a0-41fb-47d4-b73e-0c53d6202851 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:18.094091 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-bef749a0-41fb-47d4-b73e-0c53d6202851 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1980524
May 26 15:01:18.106112 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-034e190e-4b77-4b7c-b3dd-327e15a24d25 req-6d25bccc-ecde-40c2-8d0c-92a16fa7d72c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0834401
May 26 15:01:18.293965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-578e269b-7b73-4f05-ab35-a6a6262e313b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:18.299460 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-578e269b-7b73-4f05-ab35-a6a6262e313b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5b729993a1944061bb0a708877c95a5c&device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 1096 time: 0.1330655
May 26 15:01:18.427336 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-70dba442-235c-448d-adf7-01304b8d04ea service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 HTTP/1.1" status: 200  len: 217 time: 0.1048274
May 26 15:01:18.468240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e8167170-fa96-486e-a7cb-17e76c9a48b8 req-2b8dc745-f101-478a-ba95-766d784c0103 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Synchronizing usage tracker for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:18.533324 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee838d16-2113-4994-93d4-402521434f2f req-5f5cafca-e807-46bb-b1c6-6482788d04d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:18.543362 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ee838d16-2113-4994-93d4-402521434f2f req-5f5cafca-e807-46bb-b1c6-6482788d04d4 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.2147660
May 26 15:01:18.590474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-e73b61a0-1fd8-4e9c-b8c8-dd7d50bc07b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:18.591966 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-e73b61a0-1fd8-4e9c-b8c8-dd7d50bc07b3 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=bdad3913-e712-409a-9b8b-ccdccd8ad915 HTTP/1.1" status: 200  len: 854 time: 0.1150718
May 26 15:01:18.599867 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e8167170-fa96-486e-a7cb-17e76c9a48b8 req-2b8dc745-f101-478a-ba95-766d784c0103 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Unset dirty status for tenant:0ad2ab2705ca479ab4aaafe7c80de162 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:18.609291 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e8167170-fa96-486e-a7cb-17e76c9a48b8 req-2b8dc745-f101-478a-ba95-766d784c0103 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=acc03344-b5df-4277-82e4-c9b3228969ca HTTP/1.1" status: 200  len: 210 time: 0.2114871
May 26 15:01:18.634915 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ee838d16-2113-4994-93d4-402521434f2f req-9556015c-806e-4829-95c3-679ef93b4945 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0870037
May 26 15:01:18.666402 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc16837a-c61b-4718-8492-2381783ea872 req-5503b082-08ec-4e1d-b39f-dc06f426a816 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:18.673833 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dc16837a-c61b-4718-8492-2381783ea872 req-5503b082-08ec-4e1d-b39f-dc06f426a816 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.2532277
May 26 15:01:18.703478 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-38034bd6-cd8e-4885-a78b-fc4cd6a077d1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9f5bc9eb-1964-454a-a177-4bdcfc4e0298&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1010842
May 26 15:01:18.819568 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dc16837a-c61b-4718-8492-2381783ea872 req-b1ec31e7-0316-4163-a2f6-860bc43a44e7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1445987
May 26 15:01:18.844599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 0cdf2872-b922-4d87-8260-bb3c5b2a449b no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:18.917134 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 0cdf2872-b922-4d87-8260-bb3c5b2a449b {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:18.921277 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 0cdf2872-b922-4d87-8260-bb3c5b2a449b not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:18.929521 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-6434da94-30ae-4ac8-be86-9f98f57b61ac service neutron] 10.222.0.32 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2163303
May 26 15:01:19.125257 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-793343ce-d0de-4262-96ce-56a5be25c6ed req-01fbadd9-5ea0-430d-8345-c96b35b90319 service neutron] 10.222.0.32 "GET /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1852245
May 26 15:01:19.348900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c71a497-7a9b-44bf-97d4-8513986ac452 req-d83d1ed3-513d-4913-9230-af39745f7f09 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:19.351319 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3c71a497-7a9b-44bf-97d4-8513986ac452 req-d83d1ed3-513d-4913-9230-af39745f7f09 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 943 time: 0.1165349
May 26 15:01:19.397160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a7a3c9-3861-493c-9d66-e78b589a9df0 req-015e9c8b-f0b9-4469-8f87-211a21f86c28 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:19.397160 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-61a7a3c9-3861-493c-9d66-e78b589a9df0 req-015e9c8b-f0b9-4469-8f87-211a21f86c28 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1036375
May 26 15:01:19.407617 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3c71a497-7a9b-44bf-97d4-8513986ac452 req-6451fd27-7f95-41e3-8e70-623257be09ab tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0492792
May 26 15:01:19.444356 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-61a7a3c9-3861-493c-9d66-e78b589a9df0 req-b19ad490-3b48-4a8c-bd9f-e78c5b4d096c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0443885
May 26 15:01:20.120810 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37e7f67c-4f65-4233-9477-519a8bb1485b req-a5f5ad39-a42d-484f-a9f5-02bc343d6cbd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:20.122495 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-37e7f67c-4f65-4233-9477-519a8bb1485b req-a5f5ad39-a42d-484f-a9f5-02bc343d6cbd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1279535
May 26 15:01:20.178533 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-37e7f67c-4f65-4233-9477-519a8bb1485b req-52918044-5be9-4448-9f91-eed705acf0f5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0501375
May 26 15:01:20.328842 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd554f86-5988-45af-985e-0fab5dbfa319 req-7cfffb6e-00dd-4435-b96a-dc77a613f146 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:20.330497 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bd554f86-5988-45af-985e-0fab5dbfa319 req-7cfffb6e-00dd-4435-b96a-dc77a613f146 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0904138
May 26 15:01:20.377367 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bd554f86-5988-45af-985e-0fab5dbfa319 req-2726ef43-8da1-4b06-a960-4950c80870cf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0410423
May 26 15:01:20.499467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-33b3ded1-9b80-43e3-8132-acb3fc2e154b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:20.682764 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f438c4d-3704-4735-ac95-0be15f045d4c req-ce84bd39-8586-454c-a790-8f5dc4d4b65b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:20.686404 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8f438c4d-3704-4735-ac95-0be15f045d4c req-ce84bd39-8586-454c-a790-8f5dc4d4b65b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1189976
May 26 15:01:20.706376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c495f372-672b-41e6-ae67-70fa616e5c80 req-66626ba4-0091-463d-975f-3d3ce8b1ecda tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:20.707876 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c495f372-672b-41e6-ae67-70fa616e5c80 req-66626ba4-0091-463d-975f-3d3ce8b1ecda tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 943 time: 0.1216574
May 26 15:01:20.760217 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8f438c4d-3704-4735-ac95-0be15f045d4c req-a2b34b7b-a3d2-45d3-a845-42eebd74bfb0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0668218
May 26 15:01:20.804069 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c495f372-672b-41e6-ae67-70fa616e5c80 req-b454ca81-2fd4-41de-9f05-d38a219c02de tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0866401
May 26 15:01:21.411547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd38fc6-60e4-466b-844d-242d775bbcb3 req-6df9caa0-c189-4f15-955c-48b0acdf315c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:21.413223 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8fd38fc6-60e4-466b-844d-242d775bbcb3 req-6df9caa0-c189-4f15-955c-48b0acdf315c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0866001
May 26 15:01:21.476478 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8fd38fc6-60e4-466b-844d-242d775bbcb3 req-e05212ae-08b8-4dd9-9811-f02ade21b257 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0559342
May 26 15:01:21.612637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 req-d0358a65-f4fa-417d-a5ed-97dc157d8d47 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:21.614146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 req-d0358a65-f4fa-417d-a5ed-97dc157d8d47 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.0939095
May 26 15:01:21.665217 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 req-83ee17b0-0126-485c-94ab-591a4f031ff5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442817
May 26 15:01:21.716032 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 req-8c2fe1f6-bb91-46f9-89d6-31ef828a0798 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:21.717803 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 req-8c2fe1f6-bb91-46f9-89d6-31ef828a0798 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1324601
May 26 15:01:21.776036 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 req-255cad36-3789-460e-a782-86f3efc8a963 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0516129
May 26 15:01:21.791450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 59670) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:22.020030 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-97517252-6b9f-475e-ad3e-6bafc6a3be53 tempest-TestShelveInstance-1240271848 tempest-TestShelveInstance-1240271848-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:22.024451 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-97517252-6b9f-475e-ad3e-6bafc6a3be53 tempest-TestShelveInstance-1240271848 tempest-TestShelveInstance-1240271848-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1093 time: 0.2289705
May 26 15:01:22.024836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 59678) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:22.034046 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'fixed_ip_address': '172.20.0.9'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:01:22.040005 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:01:22.044545 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Usage tracker for resource:floatingip and tenant:07c65d1e254f424ebfea8360aa697c34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:01:22.047625 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:01:22.054740 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:01:22.078503 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35dee6b5-490b-43b5-a921-6d208f4e0a34 req-25a055a2-c6dc-4734-a4e4-5d8d97baeba4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:22.080307 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-35dee6b5-490b-43b5-a921-6d208f4e0a34 req-25a055a2-c6dc-4734-a4e4-5d8d97baeba4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 943 time: 0.1468782
May 26 15:01:22.126052 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for floatingip, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:22.138552 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-4f6c2952-5f37-4da1-b317-7f04b5c291df tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:22.140068 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-4f6c2952-5f37-4da1-b317-7f04b5c291df tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.1669486
May 26 15:01:22.153418 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 req-d10d002f-03ab-405c-bbd7-bcefd20c5259 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:22.154628 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-35dee6b5-490b-43b5-a921-6d208f4e0a34 req-669e218b-7cd1-4d2f-b7c0-490a1f10fcb2 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0673139
May 26 15:01:22.177818 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 req-d10d002f-03ab-405c-bbd7-bcefd20c5259 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 946 time: 0.2492454
May 26 15:01:22.308822 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 req-d7e3a51b-b0a4-470a-8059-7112d00a57d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757756
May 26 15:01:22.399687 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Deleting port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:22.400115 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:22.421476 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:22.617438 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Allocated IP 172.27.2.54 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/13c850a5-9564-48ac-9c3a-5a190d91437c) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:01:22.676797 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] For port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:22.677535 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:22.835330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling delete_port for 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:22.890816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:01:22.910617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:22.965905 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 req-21540a2e-3bb1-48bc-8e48-2813a59279a3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:22.974437 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 req-21540a2e-3bb1-48bc-8e48-2813a59279a3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1488767
May 26 15:01:23.027337 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 req-a8b4eff2-7230-44e4-934b-4c21ec80441a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0519726
May 26 15:01:23.131502 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:23.149098 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8', 'network_id': '9f5bc9eb-1964-454a-a177-4bdcfc4e0298', 'port_id': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8', 'mac_address': 'fa:16:3e:bf:5b:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1220, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bdad3913-e712-409a-9b8b-ccdccd8ad915', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:01:23.205692 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.225929 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.245332 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:01:23.245592 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3bcecd34-f775-43e4-b262-b7514fbc1b4c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:23.245737 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df', '569fad69-3482-4ba8-829b-ffd9c0bc4482', '3ab2e391-3d42-467d-8e80-fe132717746c', '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:23.265489 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.283454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0a16f7b-eab4-4886-a04e-ce88ea0fe895 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:23.337391 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-370930f8-28b5-4ea7-855a-e2e8525ecb87 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.359263 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.387808 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'Port': ['ID=13c850a5-9564-48ac-9c3a-5a190d91437c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:23.393528 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:23.394568 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:23.396186 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event deleted for resources: {'Port': ['ID=7b7c8c36-6397-47d6-91bb-4f1db62a6e1a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:23.406866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:01:23.406866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:01:23.407047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:23.408359 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:01:23.496946 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.512408 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:23.527550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] No DVR routers for this DVR port 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:23.545351 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:23.578754 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'name': 'network-vif-deleted', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:23.722131 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:23.725575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:23.832683 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f235d424-ca22-4b02-8bb2-762bd06ffe9c req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "DELETE /v2.0/ports/7b7c8c36-6397-47d6-91bb-4f1db62a6e1a HTTP/1.1" status: 204  len: 173 time: 1.6518557
May 26 15:01:23.861909 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5ae9ad7a-f33d-4cca-8a87-1bb5070abea8'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:23.989924 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21411c0a-5137-4078-b360-5eeb0259b371 req-08873d86-be0c-47db-a3eb-492b401ab140 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:24.017713 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-21411c0a-5137-4078-b360-5eeb0259b371 req-08873d86-be0c-47db-a3eb-492b401ab140 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 944 time: 0.4085684
May 26 15:01:24.073599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.136867 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-21411c0a-5137-4078-b360-5eeb0259b371 req-4d57279b-bf77-4304-8564-b77334bedd3e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1177049
May 26 15:01:24.140778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.306742 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.444513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 req-6fb08267-3c42-4436-b6bd-1baba9d9d6f3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:24.475098 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4266a63b-9328-4c00-81d2-3583ceb5d080', 'name': 'network-vif-deleted', 'tag': '7b7c8c36-6397-47d6-91bb-4f1db62a6e1a', 'status': 'completed', 'code': 200}
May 26 15:01:24.556056 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 req-6fb08267-3c42-4436-b6bd-1baba9d9d6f3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:24.566846 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 req-6fb08267-3c42-4436-b6bd-1baba9d9d6f3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=4266a63b-9328-4c00-81d2-3583ceb5d080 HTTP/1.1" status: 200  len: 210 time: 0.2164710
May 26 15:01:24.735637 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad req-9be2878b-bfd4-48cf-9adf-6cd0f894397b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:24.737676 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad req-9be2878b-bfd4-48cf-9adf-6cd0f894397b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1378665
May 26 15:01:24.784221 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.814962 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad req-b4f39d88-43fd-44d5-9c3d-722249111fef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0680609
May 26 15:01:24.829804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.829804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d6cbc363-fc0d-4588-96eb-3dcb05653869 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:24.924276 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:24.938728 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event updated for resources: {'Port': ['ID=13c850a5-9564-48ac-9c3a-5a190d91437c,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:24.943454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:24.955099 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:24.997000 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:24.997871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 7b7c8c36-6397-47d6-91bb-4f1db62a6e1a not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:25.258650 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Floating IP 0843ca0f-dd64-491b-924f-ca6157719f64 associated. External IP: 172.27.2.54, port: 24388d3c-fd02-41f5-996a-da7452902c2b.
May 26 15:01:25.365799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 req-c8ee4b0d-bb32-43a4-bc52-eff576546c99 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:25.368145 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 req-c8ee4b0d-bb32-43a4-bc52-eff576546c99 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 944 time: 0.1056976
May 26 15:01:25.436602 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 req-e2025a00-ec4e-4f0f-8ee0-58113f1f4879 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0620406
May 26 15:01:25.629474 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:25.683695 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:01:25.899105 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:01:25.911558 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Sync routers for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:01:25.935330 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:01:25.936352 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac592fa30>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:01:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:26.009930 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:26.058196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32831f96-7e65-4019-92f0-6b1494e7708e req-ce202c73-a0c7-4faa-89ac-18483e2f0fc0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:26.067420 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-32831f96-7e65-4019-92f0-6b1494e7708e req-ce202c73-a0c7-4faa-89ac-18483e2f0fc0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1095264
May 26 15:01:26.131180 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-32831f96-7e65-4019-92f0-6b1494e7708e req-2ed7d03b-9837-4a54-99b0-d7ea95b97600 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0627906
May 26 15:01:26.146108 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:01:26.175206 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 4.1489723
May 26 15:01:26.176457 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:26.236673 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'status': 'completed', 'code': 200}
May 26 15:01:26.351469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-51d3b361-fef8-47d1-821f-1de0ac5b6611 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:26.353115 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-51d3b361-fef8-47d1-821f-1de0ac5b6611 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0766034
May 26 15:01:26.562869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-3cf9e651-a0a3-4918-b73a-d42ac3ead98d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:26.566071 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-3cf9e651-a0a3-4918-b73a-d42ac3ead98d service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.2001042
May 26 15:01:26.615500 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac592fa30>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '0843ca0f-dd64-491b-924f-ca6157719f64', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'floating_ip_address': '172.27.2.54', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'mac_address': 'fa:16:3e:cc:eb:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:01:23Z', 'updated_at': '2021-05-26T15:01:23Z', 'revision_number': 0, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:26.620511 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Checking router: 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:01:26.631983 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:01:26.632594 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac592fa30>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:01:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:26.781845 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-6a0d0726-b69a-48bf-a252-e9635e30572b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 998 time: 0.1582460
May 26 15:01:26.805819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 req-5910dea1-a0e9-49a4-9c7a-377c60b26a7c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:26.814348 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 req-5910dea1-a0e9-49a4-9c7a-377c60b26a7c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 944 time: 0.2417538
May 26 15:01:26.884701 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:01:26.920005 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:01:26.948860 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 req-8826b283-343c-44a6-923b-e03a312f8303 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1333728
May 26 15:01:26.989708 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-724e41e5-a23c-4570-a2aa-c59ad2859546 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:26.992354 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-724e41e5-a23c-4570-a2aa-c59ad2859546 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.1555202
May 26 15:01:27.117454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-62353cab-fb07-4629-b530-f47c344cf93a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:27.120666 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-62353cab-fb07-4629-b530-f47c344cf93a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1158819
May 26 15:01:27.121022 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:01:27.128138 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:01:27.133844 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:27.382713 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:27.467187 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:27.469301 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:27.497340 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-a5748a30-c09b-48b4-b793-73ad7fa71822 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3680232
May 26 15:01:27.520553 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5945081b-cce9-4a67-a594-6b6916811663 req-cd4e7fb1-ba38-4a0d-b403-e65f648270a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:27.530501 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5945081b-cce9-4a67-a594-6b6916811663 req-cd4e7fb1-ba38-4a0d-b403-e65f648270a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1138232
May 26 15:01:27.537170 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac592fa30>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '0843ca0f-dd64-491b-924f-ca6157719f64', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'floating_ip_address': '172.27.2.54', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'mac_address': 'fa:16:3e:cc:eb:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:01:23Z', 'updated_at': '2021-05-26T15:01:23Z', 'revision_number': 0, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:27.539001 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e21b30-3c28-47f8-95d1-8486e03b42d1 None None] The sync data for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi is: [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '0843ca0f-dd64-491b-924f-ca6157719f64', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'floating_ip_address': '172.27.2.54', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 398, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'mac_address': 'fa:16:3e:cc:eb:6d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:01:23Z', 'updated_at': '2021-05-26T15:01:23Z', 'revision_number': 0, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:01:27.543994 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:27.545837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-463ca8c7-a847-47e4-95f3-051e92dd958e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:27.657452 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5945081b-cce9-4a67-a594-6b6916811663 req-1b58bd05-1648-4249-a59b-8a6f25ebf8e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1256897
May 26 15:01:27.700502 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:27.705657 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:27.808515 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-6392ec6d-569e-4cda-a3ba-79922c564900 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2909682
May 26 15:01:27.819404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 req-fe9437c6-4eab-47b0-b661-efc89d3b0c2d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:27.826803 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 req-fe9437c6-4eab-47b0-b661-efc89d3b0c2d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.5005245
May 26 15:01:27.921594 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a60d88ef-5c3c-4d64-82d9-49bed0327abb None None] New status for floating IP 0843ca0f-dd64-491b-924f-ca6157719f64: ACTIVE {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:01:27.936155 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 req-ca7fe242-9a9c-4a71-b703-102ec9892fba tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/security-groups?id=c89e580d-d6eb-4c8d-8572-6da7628ab71c&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1081057
May 26 15:01:27.988996 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-63a8c18c-0cf2-42b6-b02a-c52b0789e0c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:27.990514 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-63a8c18c-0cf2-42b6-b02a-c52b0789e0c5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 945 time: 0.1226752
May 26 15:01:28.063238 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8', 'code': 200}
May 26 15:01:28.160253 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Deleting port be847840-0dc2-4457-bb7b-594e083f4912 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:28.160896 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:28.406384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] For port be847840-0dc2-4457-bb7b-594e083f4912, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=be847840-0dc2-4457-bb7b-594e083f4912,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:28.406903 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:28.496577 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-192353ec-603f-499a-a4f4-834d79976ee5 req-bd951df2-8cc4-4669-8901-36808cde57f5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:28.504561 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-192353ec-603f-499a-a4f4-834d79976ee5 req-bd951df2-8cc4-4669-8901-36808cde57f5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.3272424
May 26 15:01:28.547065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b96322-b55b-4d29-85d8-0d6e0fa81d6f req-ced38469-64e6-4f01-a084-91761a7886e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:28.549715 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-57b96322-b55b-4d29-85d8-0d6e0fa81d6f req-ced38469-64e6-4f01-a084-91761a7886e8 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 1098 time: 0.1122761
May 26 15:01:28.589470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling delete_port for be847840-0dc2-4457-bb7b-594e083f4912 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:28.601721 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fdd2191-1443-47c1-abb1-d5a5288c12ab req-78e71c47-cad8-45b7-9b26-5e87ceaa4005 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:28.609605 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2fdd2191-1443-47c1-abb1-d5a5288c12ab req-78e71c47-cad8-45b7-9b26-5e87ceaa4005 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.2213287
May 26 15:01:28.626754 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-192353ec-603f-499a-a4f4-834d79976ee5 req-932aa18c-529b-47fc-adb6-9a676b897132 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1206694
May 26 15:01:28.643136 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-57b96322-b55b-4d29-85d8-0d6e0fa81d6f req-cae9014d-413d-42b9-8665-4bfe22f3e995 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0849545
May 26 15:01:28.690430 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2fdd2191-1443-47c1-abb1-d5a5288c12ab req-bbbb5ca0-2d55-48cf-9476-62137b426276 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0794966
May 26 15:01:28.874241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4347f162-e497-43e0-b760-9da5e989ffe6 req-308d81e9-2aee-4617-bc58-faf3549b0224 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:28.876388 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4347f162-e497-43e0-b760-9da5e989ffe6 req-308d81e9-2aee-4617-bc58-faf3549b0224 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1035757
May 26 15:01:28.901850 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:28.916500 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['be847840-0dc2-4457-bb7b-594e083f4912'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:28.920448 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-613010ba-b6a0-4c98-b690-d2d95e09d949 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:28.989222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Pushing event deleted for resources: {'Port': ['ID=be847840-0dc2-4457-bb7b-594e083f4912,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:28.995653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:29.048899 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4347f162-e497-43e0-b760-9da5e989ffe6 req-cd664c1c-881c-4f44-a98c-6b766f461b41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1652915
May 26 15:01:29.095467 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] No DVR routers for this DVR port be847840-0dc2-4457-bb7b-594e083f4912 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:29.099261 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:29.102011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'name': 'network-vif-deleted', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:29.140307 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 req-1baecf57-e606-4cf5-ab0c-266c84cb59cd tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 210 time: 0.0520532
May 26 15:01:29.164735 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'aa145a33-41b1-4e39-9642-132aca11fcfe', 'name': 'network-vif-deleted', 'tag': 'be847840-0dc2-4457-bb7b-594e083f4912', 'status': 'completed', 'code': 200}
May 26 15:01:29.172932 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0ca199dc-c8e1-4797-9871-363525cf6aa9 req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.32 "DELETE /v2.0/ports/be847840-0dc2-4457-bb7b-594e083f4912 HTTP/1.1" status: 204  len: 173 time: 1.1746688
May 26 15:01:29.372686 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:29.928004 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 req-35810f0e-1fb9-4b23-904a-b788383954b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:29.930711 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd req-bad70d8f-69a0-4e09-bef2-4064c11ce41c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:29.932734 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd req-bad70d8f-69a0-4e09-bef2-4064c11ce41c tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.1819215
May 26 15:01:29.933984 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 req-35810f0e-1fb9-4b23-904a-b788383954b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.1041698
May 26 15:01:29.993136 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 req-2a4dc94c-acbe-4a8b-8337-0a37a9fa9906 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0581801
May 26 15:01:30.004200 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd req-773c7c8f-d6ec-48d9-bae7-95672ab7e1b9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0647063
May 26 15:01:30.342677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13109a4-3fcc-488b-880b-c6d09997d06d req-256c5f07-77e1-4d69-be56-334feb31bc3a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:30.351494 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b13109a4-3fcc-488b-880b-c6d09997d06d req-256c5f07-77e1-4d69-be56-334feb31bc3a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1515281
May 26 15:01:30.406567 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b13109a4-3fcc-488b-880b-c6d09997d06d req-48cdfb5a-8ae4-4d02-a518-b507a5cfd63a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0536959
May 26 15:01:30.409942 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2c965528-2806-49ff-9f56-4fefc71e90a6 req-60948911-7109-475b-95be-6a489fdb3303 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /v2.0/ports?device_id=aa145a33-41b1-4e39-9642-132aca11fcfe HTTP/1.1" status: 200  len: 210 time: 0.0786798
May 26 15:01:30.713278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-937bf94d-2d61-4adf-9952-0b333c98d104 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:30.714826 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-937bf94d-2d61-4adf-9952-0b333c98d104 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.0958498
May 26 15:01:30.859981 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Deleting port 3ab2e391-3d42-467d-8e80-fe132717746c {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:30.861398 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:30.956949 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device be847840-0dc2-4457-bb7b-594e083f4912 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:31.022425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] For port 3ab2e391-3d42-467d-8e80-fe132717746c, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=3ab2e391-3d42-467d-8e80-fe132717746c,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:31.022425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:31.029987 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: be847840-0dc2-4457-bb7b-594e083f4912 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:31.030508 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device be847840-0dc2-4457-bb7b-594e083f4912 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:31.239793 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ce4684-651d-4777-9f44-68bb55b3e7ad req-bc648edf-89a3-4bc1-85f3-5a69eb5b99cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:31.241796 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e1ce4684-651d-4777-9f44-68bb55b3e7ad req-bc648edf-89a3-4bc1-85f3-5a69eb5b99cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 946 time: 0.1186936
May 26 15:01:31.290756 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e1ce4684-651d-4777-9f44-68bb55b3e7ad req-60e66c0b-4bca-4cf0-aa57-08ebf9165a03 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427282
May 26 15:01:31.321555 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling delete_port for 3ab2e391-3d42-467d-8e80-fe132717746c owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:31.402504 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 req-e4495d8e-63de-43ce-8bba-6d0671659e5e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:31.404255 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 req-e4495d8e-63de-43ce-8bba-6d0671659e5e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.2029183
May 26 15:01:31.526521 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 req-8ea872a7-cdd9-4569-9997-9be41d3f2f09 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1128089
May 26 15:01:31.592324 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 req-8222bf02-907b-4e54-b0b8-90cc122445ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:31.593846 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 req-8222bf02-907b-4e54-b0b8-90cc122445ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0865901
May 26 15:01:31.601978 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:31.619773 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df', '569fad69-3482-4ba8-829b-ffd9c0bc4482', '3ab2e391-3d42-467d-8e80-fe132717746c'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:31.630524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:31.652945 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 59812) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:31.750434 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 req-335ef0ac-9c3f-4682-a607-cab208a0558c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1406698
May 26 15:01:31.801303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event deleted for resources: {'Port': ['ID=3ab2e391-3d42-467d-8e80-fe132717746c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:31.811778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:31.814596 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] No DVR routers for this DVR port 3ab2e391-3d42-467d-8e80-fe132717746c on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:31.817054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:31.827846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'name': 'network-vif-deleted', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:31.904278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f4f8081b-28f4-4e9f-bf48-471d84e67da8', 'name': 'network-vif-deleted', 'tag': '3ab2e391-3d42-467d-8e80-fe132717746c', 'status': 'completed', 'code': 200}
May 26 15:01:31.957112 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9866a8f7-4978-4f6f-ba38-910b459f9a0d req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "DELETE /v2.0/ports/3ab2e391-3d42-467d-8e80-fe132717746c HTTP/1.1" status: 204  len: 173 time: 1.2363713
May 26 15:01:32.499189 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ab5c89ee-393d-449b-a76a-219f8c47c3ac req-ce17e120-bb1b-4ab2-bb3d-0be6092d1de2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=f4f8081b-28f4-4e9f-bf48-471d84e67da8 HTTP/1.1" status: 200  len: 210 time: 0.0561187
May 26 15:01:32.579281 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:33.066881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 req-6d43b775-b9a7-457c-81c1-7242100ea5b5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:33.075741 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 req-6d43b775-b9a7-457c-81c1-7242100ea5b5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1791499
May 26 15:01:33.168521 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 req-28aa2d48-4b85-449f-8975-db30aebae293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0917728
May 26 15:01:33.253487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Deleting port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:33.253905 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:33.394347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] For port 7f9922c0-fffc-4dc7-94bc-7dfff6c80494, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,segment=NetworkSegment(ea823f2c-1ccd-4b9d-bad1-23568a81a1e8),segment_id=ea823f2c-1ccd-4b9d-bad1-23568a81a1e8)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:33.394718 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:33.521893 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Calling delete_port for 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:34.156991 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:34.164663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6c37131a-e2ee-4b24-97f1-4819b3a1f0e2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:34.344086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d939844a-7b0f-4049-8ac7-18368d38945d req-cbd4a786-5bbc-4d0c-9aaf-75c611be0b7c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:34.346288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d939844a-7b0f-4049-8ac7-18368d38945d req-cbd4a786-5bbc-4d0c-9aaf-75c611be0b7c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:34.360921 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Pushing event deleted for resources: {'Port': ['ID=7f9922c0-fffc-4dc7-94bc-7dfff6c80494,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:34.401799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:34.440823 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d939844a-7b0f-4049-8ac7-18368d38945d req-cbd4a786-5bbc-4d0c-9aaf-75c611be0b7c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:34.442178 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d939844a-7b0f-4049-8ac7-18368d38945d req-cbd4a786-5bbc-4d0c-9aaf-75c611be0b7c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.2303498
May 26 15:01:34.509591 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d939844a-7b0f-4049-8ac7-18368d38945d req-f0c053d3-b7f6-42be-ad6a-7d7b7fb8ea8a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0587337
May 26 15:01:34.572585 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d53137-bfdd-4166-b2ac-8caf800bfe7e req-771d0e5f-0308-4cb8-97c0-111ef08efd9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:34.574130 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28d53137-bfdd-4166-b2ac-8caf800bfe7e req-771d0e5f-0308-4cb8-97c0-111ef08efd9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2065389
May 26 15:01:34.724712 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28d53137-bfdd-4166-b2ac-8caf800bfe7e req-5b897da1-415a-4306-8b68-f4a63c6b3314 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1417551
May 26 15:01:34.751388 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:34.985631 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 3ab2e391-3d42-467d-8e80-fe132717746c no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:35.035779 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 3ab2e391-3d42-467d-8e80-fe132717746c {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:35.036206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 3ab2e391-3d42-467d-8e80-fe132717746c not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:35.177994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Router f41dd35f-2e02-48d1-8348-448b3cacba7e has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:01:35.372499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:01:35.383152 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Sync routers for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:01:35.385328 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] 10.222.0.81 "PUT /v2.0/routers/f41dd35f-2e02-48d1-8348-448b3cacba7e/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.7287667
May 26 15:01:35.387662 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 59858) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:35.394877 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:01:35.395940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4fd5160>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:01:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:35.634793 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:01:35.658069 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:35.861096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4c230a-318f-4204-a938-fba287211795 req-7eba8190-7711-46ce-9e52-1fdd08707670 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:35.869169 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8c4c230a-318f-4204-a938-fba287211795 req-7eba8190-7711-46ce-9e52-1fdd08707670 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.2031059
May 26 15:01:35.930236 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8c4c230a-318f-4204-a938-fba287211795 req-5fa3474b-9e51-414e-88d3-7d46a48e3ab0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0600517
May 26 15:01:35.978543 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-c3b02636-bdd2-46e4-90b6-b22a22505e5c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:35.980496 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-c3b02636-bdd2-46e4-90b6-b22a22505e5c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 946 time: 0.2348406
May 26 15:01:36.067854 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4fd5160>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:01:34Z', 'revision_number': 5, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:36.072937 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Checking router: f41dd35f-2e02-48d1-8348-448b3cacba7e for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:01:36.084847 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Routers {'f41dd35f-2e02-48d1-8348-448b3cacba7e'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:01:36.085637 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4fd5160>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:01:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['f41dd35f-2e02-48d1-8348-448b3cacba7e'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:36.167889 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.193229 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Deleting port 569fad69-3482-4ba8-829b-ffd9c0bc4482 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:36.193718 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.206038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c48860e-7e59-4b18-85c6-85e7048e336a req-84edca41-d3d8-4ea4-8c01-0dcd09c69aaa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:36.207405 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3c48860e-7e59-4b18-85c6-85e7048e336a req-84edca41-d3d8-4ea4-8c01-0dcd09c69aaa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2383301
May 26 15:01:36.269901 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3c48860e-7e59-4b18-85c6-85e7048e336a req-21ee4127-4ff3-4348-af9f-4ee4083528f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0556955
May 26 15:01:36.332384 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] Set router f41dd35f-2e02-48d1-8348-448b3cacba7e gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:01:36.354190 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Deleting port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:36.354696 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.390248 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] For port 569fad69-3482-4ba8-829b-ffd9c0bc4482, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=569fad69-3482-4ba8-829b-ffd9c0bc4482,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:36.390889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.567521 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] For port ffc04ddb-2541-439f-a7ee-2f5bfd9daee6, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:36.568534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.581172 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling delete_port for 569fad69-3482-4ba8-829b-ffd9c0bc4482 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:36.700746 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4fd5160>, [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:01:34Z', 'revision_number': 5, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:36.711258 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1d2281e3-e68b-4520-bd9f-fdc35d2d55f4 None None] The sync data for ids ['f41dd35f-2e02-48d1-8348-448b3cacba7e'] in dv-cinder-784140-4-iscsi is: [{'id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'name': 'tempest-ServerRescueNegativeTestJSON-950198238-router', 'tenant_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100'}], 'enable_snat': True}, 'gw_port_id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:01:34Z', 'revision_number': 5, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'gw_port': {'id': 'ffc04ddb-2541-439f-a7ee-2f5bfd9daee6', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:96:61:d5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f41dd35f-2e02-48d1-8348-448b3cacba7e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:36Z', 'updated_at': '2021-05-26T14:57:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:01:36.715766 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Calling delete_port for ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:36.754942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.760488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b0920499-6be6-4588-b7d6-9184ecc81e58 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:36.769145 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df', '569fad69-3482-4ba8-829b-ffd9c0bc4482'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:36.809776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event deleted for resources: {'Port': ['ID=569fad69-3482-4ba8-829b-ffd9c0bc4482,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:36.814439 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:36.905703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] No DVR routers for this DVR port 569fad69-3482-4ba8-829b-ffd9c0bc4482 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:36.908305 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.912474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'name': 'network-vif-deleted', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:36.962156 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:36.967796 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-67c54e7b-2ba7-4d59-b681-719d67abac0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:36.973083 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '811eac08-9039-4d9e-a76f-fa4d6033f5a6', 'name': 'network-vif-deleted', 'tag': '569fad69-3482-4ba8-829b-ffd9c0bc4482', 'status': 'completed', 'code': 200}
May 26 15:01:36.987978 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-aabb7cde-5e11-49a1-adf6-44b8a79478eb req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "DELETE /v2.0/ports/569fad69-3482-4ba8-829b-ffd9c0bc4482 HTTP/1.1" status: 204  len: 173 time: 0.9991634
May 26 15:01:37.018995 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Pushing event deleted for resources: {'Port': ['ID=ffc04ddb-2541-439f-a7ee-2f5bfd9daee6,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:37.022550 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:37.113192 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:37.153340 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:37.154072 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7f9922c0-fffc-4dc7-94bc-7dfff6c80494 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:37.165420 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-97ed1bc6-57bd-4b24-a39c-e944e0752cef req-5d86e2db-75d8-4ca8-9662-c8679c116ccb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=811eac08-9039-4d9e-a76f-fa4d6033f5a6 HTTP/1.1" status: 200  len: 210 time: 0.0545459
May 26 15:01:37.193483 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.379205 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.381470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.464406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 req-d72e1c86-0f32-48cc-bd1d-6be106a1baca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:37.466019 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 req-d72e1c86-0f32-48cc-bd1d-6be106a1baca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0808706
May 26 15:01:37.510771 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 req-74fb7140-b4b7-4111-ba8e-1f2351bdc592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387571
May 26 15:01:37.537853 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.538447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Fanout notify agent at l3_agent the message router_deleted on router f41dd35f-2e02-48d1-8348-448b3cacba7e {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:01:37.556834 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.558082 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] 10.222.0.81 "DELETE /v2.0/routers/f41dd35f-2e02-48d1-8348-448b3cacba7e HTTP/1.1" status: 204  len: 168 time: 2.1692996
May 26 15:01:37.560454 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 59898) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:37.623603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Deleting subnet 71664cfa-bf05-4585-89e0-ac077a670be9 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:01:37.626608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.678072 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:37.736622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.173021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.178617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:38.214786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=71664cfa-bf05-4585-89e0-ac077a670be9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:38.217878 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:38.218859 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.227779 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] 10.222.0.81 "DELETE /v2.0/subnets/71664cfa-bf05-4585-89e0-ac077a670be9 HTTP/1.1" status: 204  len: 168 time: 0.6641324
May 26 15:01:38.228411 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 59924) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:38.404566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.534863 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.549263 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac49b3760>,) {'filters': {'network_id': ['bc70d705-69d9-4bd7-ad11-798aa6a60676']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:38.561529 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac49b3760>, 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:38.561747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac49b3760>, 'ea823f2c-1ccd-4b9d-bad1-23568a81a1e8') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:38.573635 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.590397 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.597665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Releasing vlan 1213 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:01:38.598046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:01:38.614598 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:01:38.766228 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12383201-d595-4cde-91b6-9c7c88e6933e req-b1d82b36-b90d-4a3f-88b0-9ece54e6d160 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:38.767783 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-12383201-d595-4cde-91b6-9c7c88e6933e req-b1d82b36-b90d-4a3f-88b0-9ece54e6d160 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1051531
May 26 15:01:38.803381 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.812962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:38.825459 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:38.830117 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-12383201-d595-4cde-91b6-9c7c88e6933e req-ce9a78ac-1b92-446c-bfa5-be0cdbeb0446 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0566926
May 26 15:01:38.839608 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Pushing event deleted for resources: {'Network': ['ID=bc70d705-69d9-4bd7-ad11-798aa6a60676,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:38.842476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:38.977701 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 569fad69-3482-4ba8-829b-ffd9c0bc4482 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:38.986100 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d711eb0c-4c0b-4164-9137-e69f5ecf49b7 admin admin] 10.222.0.81 "DELETE /v2.0/networks/bc70d705-69d9-4bd7-ad11-798aa6a60676 HTTP/1.1" status: 204  len: 168 time: 0.7552423
May 26 15:01:39.007993 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:39.070567 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 569fad69-3482-4ba8-829b-ffd9c0bc4482 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:39.070900 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 569fad69-3482-4ba8-829b-ffd9c0bc4482 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:39.072404 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:39.072745 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ffc04ddb-2541-439f-a7ee-2f5bfd9daee6 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:39.441601 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 59974) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:39.495823 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-284725c3-29b9-45ab-a3ae-cbe43da0d7c7 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0ad2ab2705ca479ab4aaafe7c80de162&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0528183
May 26 15:01:39.498231 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 59980) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:39.558369 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:39.588723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:39.709333 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:39.721815 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-575b60be-34d7-4216-a01a-394941b57ffb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:39.734328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c89e580d-d6eb-4c8d-8572-6da7628ab71c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:39.737263 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:39.805358 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:39.809004 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c89e580d-d6eb-4c8d-8572-6da7628ab71c HTTP/1.1" status: 204  len: 168 time: 0.3073421
May 26 15:01:40.027797 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 req-0892d96a-69f7-49ee-bc70-2e25f1fa01ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:40.029166 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 req-0892d96a-69f7-49ee-bc70-2e25f1fa01ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0839581
May 26 15:01:40.074617 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 req-136bf59c-3abf-434f-b9fb-6ea163136e37 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382309
May 26 15:01:40.310415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384327bd-6327-48c0-ac2d-11b325ae5b2d req-20dfad98-4d0e-4c7e-89b3-af01bcac16bc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:40.311184 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-384327bd-6327-48c0-ac2d-11b325ae5b2d req-20dfad98-4d0e-4c7e-89b3-af01bcac16bc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Synchronizing usage tracker for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:01:40.395182 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-384327bd-6327-48c0-ac2d-11b325ae5b2d req-20dfad98-4d0e-4c7e-89b3-af01bcac16bc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Unset dirty status for tenant:1515325707f64d58a28f26451b2c74de on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:01:40.397105 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-384327bd-6327-48c0-ac2d-11b325ae5b2d req-20dfad98-4d0e-4c7e-89b3-af01bcac16bc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.1719844
May 26 15:01:40.443792 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-384327bd-6327-48c0-ac2d-11b325ae5b2d req-7387b86a-99f6-4ee6-bcc6-8bb082b9f8ba tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409927
May 26 15:01:40.870283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60022) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:40.930987 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Deleting subnet 1ffbc503-b2cb-4a9f-8705-0778bedb7314 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:01:40.933987 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:40.989677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.046232 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.275202 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c94835-47d5-4d74-801a-e48291b40cff req-c1ae9867-f539-4a29-bd71-6bd2709893f5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:41.277322 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93c94835-47d5-4d74-801a-e48291b40cff req-c1ae9867-f539-4a29-bd71-6bd2709893f5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0924540
May 26 15:01:41.290354 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:01:41.331611 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93c94835-47d5-4d74-801a-e48291b40cff req-f4b3de0b-cedf-42b9-bc58-328cc4624fda tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0469661
May 26 15:01:41.384075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.388325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:41.422758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1ffbc503-b2cb-4a9f-8705-0778bedb7314,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:41.426355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:41.428594 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.434344 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-da0a6238-3e23-470b-9ae9-1e1e61781ebd admin admin] 10.222.0.81 "DELETE /v2.0/subnets/1ffbc503-b2cb-4a9f-8705-0778bedb7314 HTTP/1.1" status: 204  len: 168 time: 0.5628972
May 26 15:01:41.436880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60036) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:41.548155 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.793238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.811818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac404c6a0>,) {'filters': {'network_id': ['85b44080-2458-40a2-bbbd-894b0448370a']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:41.830571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac404c6a0>, '68a5ec6b-7a18-4714-970b-4f682bf72674') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:41.830867 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac404c6a0>, '68a5ec6b-7a18-4714-970b-4f682bf72674') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:41.850706 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271478d7-157c-4d82-8fa3-e1a839d8e3bf req-cfea475b-3638-40e4-ab11-6154970278d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:41.852098 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-271478d7-157c-4d82-8fa3-e1a839d8e3bf req-cfea475b-3638-40e4-ab11-6154970278d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.2970517
May 26 15:01:41.853738 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.886616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.904597 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Releasing vlan 1239 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:01:41.904973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:01:41.918084 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:01:41.973915 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-271478d7-157c-4d82-8fa3-e1a839d8e3bf req-108aaed5-44cb-4390-bd94-849a7c5e0591 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1125481
May 26 15:01:42.097743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.101608 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:42.115559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.126455 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Pushing event deleted for resources: {'Network': ['ID=85b44080-2458-40a2-bbbd-894b0448370a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:42.129573 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:42.201535 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f52d98d7-ab5f-43c8-8aeb-cce71dea0e45 admin admin] 10.222.0.81 "DELETE /v2.0/networks/85b44080-2458-40a2-bbbd-894b0448370a HTTP/1.1" status: 204  len: 168 time: 0.7636156
May 26 15:01:42.525598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 req-f40bfe75-02c7-42dc-8d6d-0ad4db12bfe0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:42.527057 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 req-f40bfe75-02c7-42dc-8d6d-0ad4db12bfe0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0841236
May 26 15:01:42.573347 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 req-791225ee-fbc5-4fee-9609-becf1a810b96 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400398
May 26 15:01:42.597272 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60052) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:42.646554 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-17ae717c-f516-4e1e-b1cc-124ea908c3e0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=dffd269c3a344d36b77ebb04d0c412e3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0480323
May 26 15:01:42.649193 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60056) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:42.710987 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.737820 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.851839 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.855385 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8e06bdd7-95a3-4cc0-a5d5-10169ad4b728 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:42.870161 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0fe11b4a-86c5-48f8-bf9f-1699f6b08150,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:42.873445 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:42.948197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:42.949311 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0fe11b4a-86c5-48f8-bf9f-1699f6b08150 HTTP/1.1" status: 204  len: 168 time: 0.2993143
May 26 15:01:43.162374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd57f372-027d-4cb4-9eba-7f46f32bb79e req-dc1d67e1-e993-4cdd-84b5-ec3776a47254 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:43.163743 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bd57f372-027d-4cb4-9eba-7f46f32bb79e req-dc1d67e1-e993-4cdd-84b5-ec3776a47254 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.0837455
May 26 15:01:43.209556 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bd57f372-027d-4cb4-9eba-7f46f32bb79e req-24f431da-ed44-4639-8c45-8cd01b343f6b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400076
May 26 15:01:43.761856 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 req-9cb20c69-28b4-41e0-a1ca-d63a130717bc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:43.763323 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 req-9cb20c69-28b4-41e0-a1ca-d63a130717bc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0821102
May 26 15:01:43.818758 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 req-c96035ab-2bf7-48d6-8d80-23d989dcafd5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0493793
May 26 15:01:44.396114 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 req-da90bcc6-6734-443c-97f8-1167a6f50175 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:44.397597 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 req-da90bcc6-6734-443c-97f8-1167a6f50175 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.0825062
May 26 15:01:44.442873 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 req-8285abe6-fb48-4c85-b3f6-425e79207977 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392370
May 26 15:01:45.014759 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dd4b546-8736-4b08-9cd8-971cb298e079 req-590ae610-6f4e-4c35-91ab-005e9a23ebbe tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:45.017098 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1dd4b546-8736-4b08-9cd8-971cb298e079 req-590ae610-6f4e-4c35-91ab-005e9a23ebbe tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0856395
May 26 15:01:45.043481 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-89d0d2f1-b597-41c2-a490-61ce53425da8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:45.045673 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-89d0d2f1-b597-41c2-a490-61ce53425da8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.0833218
May 26 15:01:45.067251 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1dd4b546-8736-4b08-9cd8-971cb298e079 req-5ffa0b88-1cb2-41f1-87fb-abb192189d0d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442772
May 26 15:01:45.200350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Deleting port 5969b659-5456-4b6d-84cd-6a9fdbac70df {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:01:45.200692 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:45.339537 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] For port 5969b659-5456-4b6d-84cd-6a9fdbac70df, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5969b659-5456-4b6d-84cd-6a9fdbac70df,segment=NetworkSegment(b964941b-0faf-494a-9f72-f6f580306e25),segment_id=b964941b-0faf-494a-9f72-f6f580306e25)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:01:45.339987 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:45.473858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling delete_port for 5969b659-5456-4b6d-84cd-6a9fdbac70df owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:01:45.667647 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c164ad-6604-41e9-bfe4-3b879c21f637 req-ecc32fc2-584a-47d6-b719-4f23b171542f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:45.669146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3c164ad-6604-41e9-bfe4-3b879c21f637 req-ecc32fc2-584a-47d6-b719-4f23b171542f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 945 time: 0.1005151
May 26 15:01:45.713334 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f3c164ad-6604-41e9-bfe4-3b879c21f637 req-07cf83c8-7328-4f6e-9720-8117599bb5dc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/security-groups?id=7e5a87ad-2426-461e-a6cd-24bd29f13f42&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0377195
May 26 15:01:45.721006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:45.727876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bf37977c-f752-4530-8016-b463d867191a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:45.735293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5969b659-5456-4b6d-84cd-6a9fdbac70df'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:01:45.807045 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Pushing event deleted for resources: {'Port': ['ID=5969b659-5456-4b6d-84cd-6a9fdbac70df,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:45.809451 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:45.852532 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] No DVR routers for this DVR port 5969b659-5456-4b6d-84cd-6a9fdbac70df on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:01:45.855126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:45.858074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'name': 'network-vif-deleted', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:01:45.904716 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '396d0570-c547-4549-8fe6-dd156ef64c4b', 'name': 'network-vif-deleted', 'tag': '5969b659-5456-4b6d-84cd-6a9fdbac70df', 'status': 'completed', 'code': 200}
May 26 15:01:45.938747 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1bfc2c97-7a36-43be-948d-dfa1df72096b req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.32 "DELETE /v2.0/ports/5969b659-5456-4b6d-84cd-6a9fdbac70df HTTP/1.1" status: 204  len: 173 time: 0.8870945
May 26 15:01:46.276199 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a req-0e030411-4a9b-4472-98d9-3d6fdbb84dd3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:46.277802 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a req-0e030411-4a9b-4472-98d9-3d6fdbb84dd3 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0834792
May 26 15:01:46.323728 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a req-431af6eb-6f4e-4238-ae5c-db0b5905c318 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396256
May 26 15:01:46.873086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c16b16cc-a32f-4c18-9179-46c5c2c2064a req-aeedd0b5-86e0-4ca4-82d5-9064737b887b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:46.874624 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c16b16cc-a32f-4c18-9179-46c5c2c2064a req-aeedd0b5-86e0-4ca4-82d5-9064737b887b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0915372
May 26 15:01:46.892406 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ea0d353e-bc22-4fd6-a36f-635d962f901d req-f804604a-1788-48d2-a50e-4a048bd2740b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0489986
May 26 15:01:46.922351 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c16b16cc-a32f-4c18-9179-46c5c2c2064a req-94f32c3f-474a-4ce7-98e8-455208659d5d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0414636
May 26 15:01:48.059130 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9905ce45-8846-47fa-a26b-dd79205aab27 req-9626fee4-0110-4a6b-bfd3-6dbf48ab7cf5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0433028
May 26 15:01:48.109329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 req-0eccdf8a-0907-4b65-b7a9-4146b6b4a627 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:48.111574 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 req-0eccdf8a-0907-4b65-b7a9-4146b6b4a627 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0824463
May 26 15:01:48.158046 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 req-cf6c3ba8-f740-499e-adca-1b3d46eef2ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403435
May 26 15:01:48.447177 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5969b659-5456-4b6d-84cd-6a9fdbac70df no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:01:48.484481 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 5969b659-5456-4b6d-84cd-6a9fdbac70df {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:01:48.484891 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5969b659-5456-4b6d-84cd-6a9fdbac70df not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:01:49.368193 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-936a216e-c766-476a-80b0-405decf8bb32 req-846412ba-cff3-4bf7-af8e-c8957186e29f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /v2.0/ports?device_id=396d0570-c547-4549-8fe6-dd156ef64c4b HTTP/1.1" status: 200  len: 210 time: 0.0434344
May 26 15:01:49.410334 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74923760-db6a-4f33-90e2-36fb9cb18e41 req-4c302cd4-dec7-492f-8aaa-78ebbcd498e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:49.411792 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-74923760-db6a-4f33-90e2-36fb9cb18e41 req-4c302cd4-dec7-492f-8aaa-78ebbcd498e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1455708
May 26 15:01:49.455928 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-74923760-db6a-4f33-90e2-36fb9cb18e41 req-d565aba9-6ac6-4246-8af6-d63c114c515d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0383921
May 26 15:01:49.727208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73868582-7497-4470-8aca-a92eb1c3496c req-4375c26e-5e5f-47ed-8cfe-7e82f9b1d95d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:49.728672 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-4375c26e-5e5f-47ed-8cfe-7e82f9b1d95d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 1098 time: 0.0753183
May 26 15:01:49.871550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73868582-7497-4470-8aca-a92eb1c3496c req-22b51b28-3870-4600-bb3d-2731316e213f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:49.872877 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-22b51b28-3870-4600-bb3d-2731316e213f service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.1357996
May 26 15:01:49.972819 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-845fcd09-bd13-418a-8950-d40b05e2129a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 200  len: 1000 time: 0.0933447
May 26 15:01:50.041808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73868582-7497-4470-8aca-a92eb1c3496c req-eb9ccab9-a9cf-450c-bc43-dcfc07e3078f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:50.043275 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-eb9ccab9-a9cf-450c-bc43-dcfc07e3078f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.0631137
May 26 15:01:50.121023 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73868582-7497-4470-8aca-a92eb1c3496c req-de2bb461-7ec2-4080-b618-10b3b90680ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:50.122603 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-de2bb461-7ec2-4080-b618-10b3b90680ab service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0723495
May 26 15:01:50.261398 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-39eb01ea-64b1-4774-aa89-73d509948a08 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1266847
May 26 15:01:50.400424 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-73868582-7497-4470-8aca-a92eb1c3496c req-124e64d3-e6f1-4248-8427-5d488144727b service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1308165
May 26 15:01:50.474982 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60180) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:50.521068 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2f9324b1-e00e-4996-b54b-074d7aac8504 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:50.545694 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Deleting subnet a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:01:50.545694 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:50.646226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:50.711089 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:50.756558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c061445-0049-474a-8dd2-27d7dacbceee req-617289b1-5f67-4a7e-849e-7adc7c2711b1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:50.758074 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c061445-0049-474a-8dd2-27d7dacbceee req-617289b1-5f67-4a7e-849e-7adc7c2711b1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1870146
May 26 15:01:50.891986 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5c061445-0049-474a-8dd2-27d7dacbceee req-4a93d598-5f77-4bd4-97f9-ac719d65158a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1269240
May 26 15:01:51.110182 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.115294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:51.151292 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a5c1fbe6-787f-4fc0-9f39-1179f60b94a5,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:51.154315 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:51.155288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.161307 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-c54d806e-a260-48a5-9722-4dc7eeae534c admin admin] 10.222.0.81 "DELETE /v2.0/subnets/a5c1fbe6-787f-4fc0-9f39-1179f60b94a5 HTTP/1.1" status: 204  len: 168 time: 0.6852653
May 26 15:01:51.163703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60198) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:51.272036 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.351964 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60204) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:51.479659 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.492268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.494546 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4927eb0>,) {'filters': {'network_id': ['5bdb145e-267b-43cd-9426-f92f373c5ed5']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:51.509353 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:01:51.509521 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4927eb0>, 'b964941b-0faf-494a-9f72-f6f580306e25') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:51.509849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4927eb0>, 'b964941b-0faf-494a-9f72-f6f580306e25') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:01:51.513632 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Usage tracker for resource:security_group_rule and tenant:710cab13489e43399ab55fe8ea719763 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:01:51.516593 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:01:51.523499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:01:51.525948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.544744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.553021 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Releasing vlan 1233 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:01:51.553591 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:01:51.576738 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:01:51.632050 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.715243 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.715440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.719900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:51.731682 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7d6f47a7-affc-4bb1-be3b-c7777eed3394 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:51.740202 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.746204 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Pushing event deleted for resources: {'Network': ['ID=5bdb145e-267b-43cd-9426-f92f373c5ed5,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:51.750751 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:51.773676 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=710cab13489e43399ab55fe8ea719763&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4206102
May 26 15:01:51.775619 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c3084dc-2f40-495d-88fb-51966afa01d0,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:51.776528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60220) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:51.779090 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:51.821522 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-09578072-b73e-4051-8972-4b3ee68d4d36 admin admin] 10.222.0.81 "DELETE /v2.0/networks/5bdb145e-267b-43cd-9426-f92f373c5ed5 HTTP/1.1" status: 204  len: 168 time: 0.6568086
May 26 15:01:51.841320 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:51.874133 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.006653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.012046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-770afef8-ad3b-4ad6-bb08-bd33c437be71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:52.023410 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c3084dc-2f40-495d-88fb-51966afa01d0,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:52.027126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:52.032057 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.032057 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4c3084dc-2f40-495d-88fb-51966afa01d0 HTTP/1.1" status: 204  len: 168 time: 0.2541709
May 26 15:01:52.092771 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 req-8b8b734c-6322-48f9-b1d7-0c183280eec6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:52.094525 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 req-8b8b734c-6322-48f9-b1d7-0c183280eec6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0865142
May 26 15:01:52.139346 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 req-8ae02e2d-606b-45b4-acdf-0eb0e98975b6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393186
May 26 15:01:52.208087 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60232) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:52.256556 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-03b83a21-c2f5-4203-8a55-eff724f71d3a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1515325707f64d58a28f26451b2c74de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0472052
May 26 15:01:52.258924 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60236) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:01:52.317884 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.343604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.452136 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.457274 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7c873766-d62e-411a-b87a-8618bcdc5cde admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:01:52.471443 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e5a87ad-2426-461e-a6cd-24bd29f13f42,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:01:52.473712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:01:52.514367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:52.517729 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7e5a87ad-2426-461e-a6cd-24bd29f13f42 HTTP/1.1" status: 204  len: 168 time: 0.2559724
May 26 15:01:53.143644 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:53.217398 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-baff3eee-61b6-432c-8094-ee16b304a345 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:54.108993 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:55.600400 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:01:56.460974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea req-7fa240e9-71fe-45a4-b8aa-a43def82cf9e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:56.462472 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea req-7fa240e9-71fe-45a4-b8aa-a43def82cf9e tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.0939162
May 26 15:01:56.511800 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea req-d0226244-f4a1-45f0-a1ba-efb75f4a2d95 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0436463
May 26 15:01:57.699475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5679936-9119-4784-9c46-f4626de38792 req-1cf7d697-1c12-40d5-8cb2-7db81197cf43 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:57.700929 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5679936-9119-4784-9c46-f4626de38792 req-1cf7d697-1c12-40d5-8cb2-7db81197cf43 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.0811846
May 26 15:01:57.745325 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5679936-9119-4784-9c46-f4626de38792 req-9772d034-4095-470d-aad7-e2f8a8d42f03 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0380123
May 26 15:01:58.928445 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46c36397-8e4b-4b61-81c9-b963993c996d req-ab7cb0f4-ccbc-46a0-b443-85d820924a13 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:01:58.929941 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-46c36397-8e4b-4b61-81c9-b963993c996d req-ab7cb0f4-ccbc-46a0-b443-85d820924a13 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.0806599
May 26 15:01:58.979028 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-46c36397-8e4b-4b61-81c9-b963993c996d req-fc7d1c8d-8df2-4c9e-8a2f-928665f7b720 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0432122
May 26 15:01:59.383269 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:00.174728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-063f3ea2-8027-4956-b686-56c9d1f14cae req-d7f5236d-69d7-401b-8ad9-66b182a22dd4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:00.176210 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-063f3ea2-8027-4956-b686-56c9d1f14cae req-d7f5236d-69d7-401b-8ad9-66b182a22dd4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.0861523
May 26 15:02:00.225732 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-063f3ea2-8027-4956-b686-56c9d1f14cae req-26854a2c-9e03-42f6-88cf-27565e3299fe tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/security-groups?id=63b52cba-73eb-4a19-a99c-4bdf00795972&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0424364
May 26 15:02:00.524325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-21a33893-7c91-48c1-9ba0-71519b39c4ee tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:00.526095 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-21a33893-7c91-48c1-9ba0-71519b39c4ee tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 945 time: 0.0827491
May 26 15:02:00.667653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Deleting port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:02:00.667980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:00.814125 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] For port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,segment=NetworkSegment(324ba4e6-313b-4b92-81fd-29df319c25e1),segment_id=324ba4e6-313b-4b92-81fd-29df319c25e1)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:00.814707 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:00.868974 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60470) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:00.972473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling delete_port for 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:02:01.007294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.022658 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:01.026755 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Usage tracker for resource:security_group_rule and tenant:2e5a8886084e4930880aae0681682c17 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:01.029599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:01.035621 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:01.131950 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.137721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-836ebbc3-434f-43c8-9d8e-2b1e6a103b59 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:01.144883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5ae9ad7a-f33d-4cca-8a87-1bb5070abea8'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:02:01.182330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Pushing event deleted for resources: {'Port': ['ID=5ae9ad7a-f33d-4cca-8a87-1bb5070abea8,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:01.186004 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:01.215394 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.258999 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.271392 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-702497a8-cf36-427b-ac38-17cec094a6fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:01.276279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] No DVR routers for this DVR port 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:02:01.279101 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.293209 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'name': 'network-vif-deleted', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:01.332815 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60486) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:01.333796 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2e5a8886084e4930880aae0681682c17&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4635577
May 26 15:02:01.335963 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92cc4873-09c2-4289-b09c-da4d6e6ed704,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:01.346463 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.346999 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.347508 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.348014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.348523 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.349031 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.349376 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.349919 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.350342 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.350667 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.351037 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.351396 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:01.355577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:01.357300 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2d11ba61-751c-43a5-9a56-5638a6afe727', 'name': 'network-vif-deleted', 'tag': '5ae9ad7a-f33d-4cca-8a87-1bb5070abea8', 'status': 'completed', 'code': 200}
May 26 15:02:01.361178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60490) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:01.362585 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-47d6412c-7373-4a5d-a4e0-7b380e300939 req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.32 "DELETE /v2.0/ports/5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 HTTP/1.1" status: 204  len: 173 time: 0.8309703
May 26 15:02:01.401161 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7ddb5370-e735-4be4-82de-0f35f9920423 req-37714951-4682-43b3-8c8b-b233b7391fe1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0572727
May 26 15:02:01.417828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.444595 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.507586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.523686 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:01.527718 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Usage tracker for resource:security_group_rule and tenant:c1607cb67163487f8b5d2d360c83b8a8 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:01.530529 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:01.537575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:01.577638 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.585299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f126fb98-2f69-46dc-9c49-e3cd29d26c00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:01.603052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92cc4873-09c2-4289-b09c-da4d6e6ed704,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:01.611496 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:01.614047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.616629 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/92cc4873-09c2-4289-b09c-da4d6e6ed704 HTTP/1.1" status: 204  len: 168 time: 0.2809722
May 26 15:02:01.672920 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.720027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.727849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0b9e3c78-ca35-4ba1-a9d7-d3ffe3cecba8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:01.767728 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c1607cb67163487f8b5d2d360c83b8a8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4042447
May 26 15:02:01.769312 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2570463-d133-4e3e-a287-ecbe8c38a3bf,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:01.770402 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60500) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:01.772252 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:01.832715 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:01.858730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.034840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.040015 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dd1cb42d-5dd0-4233-9a0f-7024173eb242 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:02.054598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2570463-d133-4e3e-a287-ecbe8c38a3bf,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:02.057340 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:02.067083 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.068234 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b2570463-d133-4e3e-a287-ecbe8c38a3bf HTTP/1.1" status: 204  len: 168 time: 0.2968333
May 26 15:02:02.288536 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60510) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:02.307919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.323355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:02.327297 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Usage tracker for resource:security_group_rule and tenant:b3bdb69cf6c340218c24afaef82839c1 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:02.330525 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:02.336414 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:02.420300 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.480636 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.493939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f4f85e51-d81a-4073-82b0-1b4ce96f9184 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:02.631046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 req-bbd21965-f2b6-4ec8-9997-0c485bea60d9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Synchronizing usage tracker for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:02.637410 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=b3bdb69cf6c340218c24afaef82839c1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3478649
May 26 15:02:02.639027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=835c2d32-102b-4205-bc08-77170083ea1b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:02.640215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60526) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:02.643531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:02.703850 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.708756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 req-bbd21965-f2b6-4ec8-9997-0c485bea60d9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Unset dirty status for tenant:5b729993a1944061bb0a708877c95a5c on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:02.718635 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 req-bbd21965-f2b6-4ec8-9997-0c485bea60d9 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.1498530
May 26 15:02:02.730189 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.869215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.874299 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-148d5880-ec47-4fd3-92bc-e890fa293c9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:02.891362 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=835c2d32-102b-4205-bc08-77170083ea1b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:02.893827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:02.897655 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:02.901415 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/835c2d32-102b-4205-bc08-77170083ea1b HTTP/1.1" status: 204  len: 168 time: 0.2574575
May 26 15:02:03.867154 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92ae2467-83e7-4023-9b20-c696b3d7eeba req-40fa49ca-5e96-4d8d-a795-562e44bc7433 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0456991
May 26 15:02:04.278458 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-c5f8d361-5012-497c-b3d2-db2728ad2147 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0840101
May 26 15:02:04.388152 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-637dd5bb-e9d2-47d1-be9e-cf57761ad7b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:04.389640 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-637dd5bb-e9d2-47d1-be9e-cf57761ad7b0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 1100 time: 0.0805066
May 26 15:02:04.652979 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-4820168d-687c-4f4e-8808-87cb061868e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:04.654482 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-4820168d-687c-4f4e-8808-87cb061868e9 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.2324214
May 26 15:02:04.740565 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60600) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:04.773563 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-5427c25a-896e-48d9-a76f-eecf65858dd7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 200  len: 1001 time: 0.1072297
May 26 15:02:04.851666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-85e119a3-13a0-49e2-9a3b-6fb8ef637e7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:04.853110 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-85e119a3-13a0-49e2-9a3b-6fb8ef637e7f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0627158
May 26 15:02:04.950087 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-23b54f5b-7322-411d-a56b-bc1fcc6aa3ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:04.952307 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-23b54f5b-7322-411d-a56b-bc1fcc6aa3ec service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0837493
May 26 15:02:05.102124 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-418c7cd3-076a-457c-aa7e-9134fe030603 req-b2683e0d-d62d-447c-a11a-48099051c316 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /v2.0/ports?device_id=2d11ba61-751c-43a5-9a56-5638a6afe727 HTTP/1.1" status: 200  len: 210 time: 0.0960484
May 26 15:02:05.109160 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.126105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:05.134776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Usage tracker for resource:security_group_rule and tenant:a3e14c6126c14a34b2d72a5819924f0c is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:05.134776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:05.141257 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:05.168924 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-2bde1eec-472d-4888-a654-534939a1de17 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2079599
May 26 15:02:05.244243 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.322086 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-aa2b19a9-718e-4c98-b2d0-3bd76fe2f9df req-3b58e149-fc8b-4542-9a21-9977b38de380 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1416979
May 26 15:02:05.366196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.375250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-810eb026-1105-4cb2-aadf-fff99cc8e0d3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:05.422002 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a3e14c6126c14a34b2d72a5819924f0c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6792648
May 26 15:02:05.423303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28493abd-bba5-4fb1-9af3-8ea4460bcf30,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:05.425701 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60628) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:05.433488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.433891 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.437374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:05.442829 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:05.493794 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.527456 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.658049 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.661827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-93f923eb-63a5-40a4-b55d-39c9898ead9a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:05.673395 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28493abd-bba5-4fb1-9af3-8ea4460bcf30,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:05.676774 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:05.679994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:05.681087 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3b6bc39a-4e2f-4198-bccd-0605de006504 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/28493abd-bba5-4fb1-9af3-8ea4460bcf30 HTTP/1.1" status: 204  len: 168 time: 0.2544210
May 26 15:02:06.028517 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60646) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:06.147694 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.162763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:06.171420 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Usage tracker for resource:security_group_rule and tenant:db006feffad54ec9873d5f8cf8cc9022 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:06.175612 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:06.181393 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:06.266217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.314947 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.323734 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-aa1d2c7b-9dd4-4e86-a414-428d4bce8163 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:06.367364 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=db006feffad54ec9873d5f8cf8cc9022&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3377695
May 26 15:02:06.368991 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=37194bba-9560-4f0a-8013-cbe6a2e25466,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:06.370284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60656) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:06.372021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:06.412934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60660) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:06.431668 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.432135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.446510 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:06.450392 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Usage tracker for resource:security_group_rule and tenant:f738cd187b094a8489719ab584b86f34 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:06.459082 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:06.462016 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.465420 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:06.549611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.565940 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.571120 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-771cfd01-95a9-4ad8-a1d9-e58a75ae17fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:06.586366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=37194bba-9560-4f0a-8013-cbe6a2e25466,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:06.589991 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:06.607915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.607915 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/37194bba-9560-4f0a-8013-cbe6a2e25466 HTTP/1.1" status: 204  len: 168 time: 0.2336645
May 26 15:02:06.617572 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.627343 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d544bab-0f68-48cb-9be8-a37994797f8c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:06.667719 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f738cd187b094a8489719ab584b86f34&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2536263
May 26 15:02:06.668634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b6cd975-75d8-48af-95ba-be760c5726f7,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:06.670857 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60668) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:06.671908 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:06.733685 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.759652 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.892924 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.898093 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-971dc611-4c58-427b-aa5f-aafa071d773f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:06.900380 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:02:06.914337 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b6cd975-75d8-48af-95ba-be760c5726f7,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:06.917441 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:06.919778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:06.926351 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7b6cd975-75d8-48af-95ba-be760c5726f7 HTTP/1.1" status: 204  len: 168 time: 0.2503877
May 26 15:02:06.952078 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:02:06.952492 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:02:07.389701 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60684) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:07.408240 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.426409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:07.430243 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Usage tracker for resource:security_group_rule and tenant:e4e032ef1aee4b90a4d6f89ae68e9502 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:07.433060 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:07.438858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:07.524947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.617269 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.626583 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f37d29b6-388a-4b22-a193-895ea90d159b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:07.670497 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e4e032ef1aee4b90a4d6f89ae68e9502&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2796578
May 26 15:02:07.671486 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58f430a4-0689-4410-adff-7ef128362edd,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:07.673345 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60696) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:07.675251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:07.733243 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.758354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.868773 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.873726 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b5bf742b-0d36-4490-a58d-56b591f47459 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:07.889033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58f430a4-0689-4410-adff-7ef128362edd,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:07.894199 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:07.901079 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:07.904515 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/58f430a4-0689-4410-adff-7ef128362edd HTTP/1.1" status: 204  len: 168 time: 0.2279260
May 26 15:02:09.892552 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60798) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:10.022239 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.037728 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:10.042266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Usage tracker for resource:security_group_rule and tenant:0a7f0701142a4036aed264df5666044e is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:10.046225 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:10.052898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:10.149148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.235072 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.244269 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9897dc2e-121a-4e08-b4eb-cbf531868687 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:10.285646 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=0a7f0701142a4036aed264df5666044e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3919914
May 26 15:02:10.286707 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af1d4ea4-19bb-4862-b47a-d261702d4f6a,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:10.288233 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60824) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:10.295283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:10.350729 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.377829 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.497328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.504470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0971491d-d293-4a2e-becf-288036e1f74c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:10.519649 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af1d4ea4-19bb-4862-b47a-d261702d4f6a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:10.522560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:10.527042 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:10.528146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/af1d4ea4-19bb-4862-b47a-d261702d4f6a HTTP/1.1" status: 204  len: 168 time: 0.2381144
May 26 15:02:11.223711 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60856) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:11.241086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.255738 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:11.259522 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Usage tracker for resource:security_group_rule and tenant:02dcc414bc90467ab809f8357a7fd318 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:11.262326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:11.268917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:11.347892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.388360 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.395460 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7973d9dc-59e7-4a73-b1d8-90811512516d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:11.436848 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=02dcc414bc90467ab809f8357a7fd318&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2121065
May 26 15:02:11.438573 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7cba18ee-9c07-4ae8-b32a-3ab80bf06c26,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:11.440171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60860) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:11.442405 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:11.502366 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.528533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.662905 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.666500 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e1ad4236-7ec1-428e-a206-6ada81355c0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:11.679197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cba18ee-9c07-4ae8-b32a-3ab80bf06c26,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:11.682862 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:11.688182 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:11.689279 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7cba18ee-9c07-4ae8-b32a-3ab80bf06c26 HTTP/1.1" status: 204  len: 168 time: 0.2481256
May 26 15:02:15.525374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 60968) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:15.648854 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:15.667490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:15.669132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Usage tracker for resource:security_group_rule and tenant:bdb275bc01f14bd992c24989c707c950 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:15.672838 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:15.679055 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:15.765266 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:15.874904 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:15.887397 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f8f2bd95-2d21-4415-807d-0ea2c340b54e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:15.927352 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bdb275bc01f14bd992c24989c707c950&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4007907
May 26 15:02:15.929004 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aeaae958-7d55-4da1-853b-aaca402ef8a4,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:15.930041 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 60984) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:15.931907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:15.991135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:16.022308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:16.149127 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:16.154336 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f305768e-ef49-4858-bf69-084efd737209 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:16.168153 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aeaae958-7d55-4da1-853b-aaca402ef8a4,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:16.170798 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:16.172082 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:16.175294 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c0ce27ea-4cee-4822-a485-1e7ae0873357 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/aeaae958-7d55-4da1-853b-aaca402ef8a4 HTTP/1.1" status: 204  len: 168 time: 0.2420363
May 26 15:02:16.808725 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 32768) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:16.831048 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:16.845937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:16.850014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Usage tracker for resource:security_group_rule and tenant:c5d4643c23e64ae29a1ecdeefb660f1c is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:16.852987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:16.859098 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:16.941245 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.114824 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.124139 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f1cd1434-7b40-43df-af0a-bcce7843c3b0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:17.164898 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c5d4643c23e64ae29a1ecdeefb660f1c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3550742
May 26 15:02:17.165821 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9b9cb0c3-f0f5-4303-92ec-609c0dc03f0f,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:17.167620 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 32780) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:17.169417 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9c6bf8be-bb80-4d69-94d2-be1caea7588a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:17.227409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.253514 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.383156 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.388203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4264ed1-8365-4252-87cb-7f72cedbf821 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:17.402697 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9b9cb0c3-f0f5-4303-92ec-609c0dc03f0f,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:17.407185 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:17.414712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:17.415826 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/9b9cb0c3-f0f5-4303-92ec-609c0dc03f0f HTTP/1.1" status: 204  len: 168 time: 0.2472434
May 26 15:02:18.289295 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:02:19.745758 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 32868) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:19.870464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:19.884798 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:19.888552 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Usage tracker for resource:security_group_rule and tenant:1461a22e6d514bdeaf797faae6973578 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:19.892141 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:19.897915 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:19.982433 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.091819 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.102775 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dcd635fe-8bf8-4966-835b-125b09dab4fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:20.158006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01e1c4ab-c6d1-42aa-909b-24bfdd9840b3,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:20.165409 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1461a22e6d514bdeaf797faae6973578&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4185071
May 26 15:02:20.165955 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 32884) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:20.167165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fe637fb4-7eb9-462d-a1b7-e67ac251d26a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:20.218841 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 32888) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:20.265776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.292137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.351256 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.367553 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:20.373242 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Usage tracker for resource:security_group_rule and tenant:95e18b5c78da42dbbd5146280dc898fe is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:20.376971 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:20.382738 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:20.428993 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.434447 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2b2ab0eb-6dae-4375-b546-e8ea76c1be7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:20.448097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01e1c4ab-c6d1-42aa-909b-24bfdd9840b3,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:20.450865 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:20.455287 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.462478 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/01e1c4ab-c6d1-42aa-909b-24bfdd9840b3 HTTP/1.1" status: 204  len: 168 time: 0.2911310
May 26 15:02:20.521800 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.560420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2b296e07-3b8b-48ef-be52-75be8d4e3b08 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.588954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.598628 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:20.637407 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=95e18b5c78da42dbbd5146280dc898fe&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4173105
May 26 15:02:20.639645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a85e023-0d65-4920-975d-72f5116091e9,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:20.641223 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 32900) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:20.643369 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:20.743476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.784560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.972177 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:20.979533 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-329d5412-b480-43f5-be12-637e5c1719e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:20.996246 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a85e023-0d65-4920-975d-72f5116091e9,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:21.003518 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:21.018116 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/3a85e023-0d65-4920-975d-72f5116091e9 HTTP/1.1" status: 204  len: 168 time: 0.3757606
May 26 15:02:21.022713 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:21.560770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 req-d81c6fc2-b7cd-46ca-a100-be264ec1222b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:21.562818 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 req-d81c6fc2-b7cd-46ca-a100-be264ec1222b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0985875
May 26 15:02:21.608441 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 req-797c4861-bfd6-489e-9a99-1d9de39ba289 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395296
May 26 15:02:22.815843 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 req-7052f8ec-23ab-4ab8-8439-65d224afa46b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:22.817316 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 req-7052f8ec-23ab-4ab8-8439-65d224afa46b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0882936
May 26 15:02:22.863716 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 req-64f23896-2671-463b-9b0d-488ff0a3ff02 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0403304
May 26 15:02:23.126176 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:23.154541 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-85900e8a-4809-4c69-9622-33dfed17ea04 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:24.047722 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:24.064612 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 req-e513754a-3b74-4b9f-a13a-55998f867920 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:24.066125 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 req-e513754a-3b74-4b9f-a13a-55998f867920 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0891554
May 26 15:02:24.116454 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 req-20a705a7-8858-4221-b2d2-d8ccb49e9798 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0442681
May 26 15:02:25.305474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f26915b2-f18e-4409-94be-b06751a7a0d3 req-4b324b85-94f9-4d09-899a-abf8efb05a60 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:25.306862 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f26915b2-f18e-4409-94be-b06751a7a0d3 req-4b324b85-94f9-4d09-899a-abf8efb05a60 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0788088
May 26 15:02:25.354648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f26915b2-f18e-4409-94be-b06751a7a0d3 req-94cdad86-d27a-445d-9600-3e473392726d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417619
May 26 15:02:25.365028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a006639b-9afc-47c3-95b3-923198b8f42f req-89e98162-d2ff-4247-b36a-de0071397e6a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:25.367128 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a006639b-9afc-47c3-95b3-923198b8f42f req-89e98162-d2ff-4247-b36a-de0071397e6a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 947 time: 0.0858870
May 26 15:02:25.602487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Deleting port e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:02:25.602743 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:25.629466 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:25.743580 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] For port e948d481-711f-45b8-8deb-08b7658709e7, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e948d481-711f-45b8-8deb-08b7658709e7,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:25.744025 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:26.039418 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:26.039779 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:26.040080 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Floating IP f6d82bda-ca13-43e4-aa88-cfcb9153aeaa disassociated. External IP: 172.27.2.62, port: e948d481-711f-45b8-8deb-08b7658709e7.
May 26 15:02:26.040406 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling delete_port for e948d481-711f-45b8-8deb-08b7658709e7 owned by compute:nova {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:02:26.229181 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:26.237413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:26.287644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'Port': ['ID=e948d481-711f-45b8-8deb-08b7658709e7,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:26.290214 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:26.533944 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 req-8dbf336f-c303-4cbb-81bf-98c6ca3911e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 210 time: 0.0518007
May 26 15:02:26.554526 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:02:26.748135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:26.759202 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:26.772872 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:26.773919 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2f10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:26.824711 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] No DVR routers for this DVR port e948d481-711f-45b8-8deb-08b7658709e7 on host hv-cinder-78414 {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:02:26.846356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:26.846356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-deleted', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:26.901754 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '598b0e3f-8cf1-451a-80a8-ed7e5dd36984', 'name': 'network-vif-deleted', 'tag': 'e948d481-711f-45b8-8deb-08b7658709e7', 'status': 'completed', 'code': 200}
May 26 15:02:26.928446 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a006639b-9afc-47c3-95b3-923198b8f42f req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "DELETE /v2.0/ports/e948d481-711f-45b8-8deb-08b7658709e7 HTTP/1.1" status: 204  len: 173 time: 1.5534520
May 26 15:02:26.973933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:27.306447 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2f10>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:27.310441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:27.319257 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:27.319855 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2f10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:27.498179 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:27.771160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-82fdabd5-b296-47d5-ace4-fe663764d0d0 req-437ab280-aec9-4182-8faf-eb021891f20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:27.880097 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2f10>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:27.884142 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ece83efd-6253-4a79-99c7-17a3c49744d4 None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:27.892183 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-82fdabd5-b296-47d5-ace4-fe663764d0d0 req-437ab280-aec9-4182-8faf-eb021891f20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:27.893703 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-82fdabd5-b296-47d5-ace4-fe663764d0d0 req-437ab280-aec9-4182-8faf-eb021891f20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=598b0e3f-8cf1-451a-80a8-ed7e5dd36984 HTTP/1.1" status: 200  len: 210 time: 0.1803532
May 26 15:02:28.112553 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5f9fc1d-d504-4829-a402-2dff79e584f3 None None] New status for floating IP f6d82bda-ca13-43e4-aa88-cfcb9153aeaa: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:02:28.316648 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:02:28.353288 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: e948d481-711f-45b8-8deb-08b7658709e7 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:02:28.353674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e948d481-711f-45b8-8deb-08b7658709e7 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:02:29.127898 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33066) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:29.194384 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.224862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.337124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.342404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8515d3e9-88c4-4b85-b60b-68f9a9c1dddd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:29.357409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:29.360444 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:29.373068 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.422267 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.423299 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /v2.0/security-groups/1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be HTTP/1.1" status: 204  len: 168 time: 0.2943087
May 26 15:02:29.426027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33072) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:29.442646 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.api.v2.resource [None req-4f675b41-3d62-4828-ba1e-e8ef49188515 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] show failed (client error): The resource could not be found.
May 26 15:02:29.443582 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-4f675b41-3d62-4828-ba1e-e8ef49188515 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups/1bba79d8-40f6-4a5f-b37b-cc6c8fb8b2be HTTP/1.1" status: 404  len: 347 time: 0.0166845
May 26 15:02:29.446340 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33076) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:29.683506 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Deleting port 837c6543-81e9-4a07-90ea-cad486d8bf26 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:02:29.683846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.873230 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.873586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:29.971568 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33094) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:30.006015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling delete_port for 837c6543-81e9-4a07-90ea-cad486d8bf26 owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:02:30.096323 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.111625 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:30.115834 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Usage tracker for resource:security_group_rule and tenant:1e2175c3c27b4445ad2950fb37b503a3 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:30.119045 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:30.125412 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:30.206059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.206268 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.210834 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:30.252852 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'Port': ['ID=837c6543-81e9-4a07-90ea-cad486d8bf26,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:30.255886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:30.263055 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.272533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-33a22cb9-be55-48fe-9105-27a8b33f7112 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:30.316690 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=1e2175c3c27b4445ad2950fb37b503a3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3416874
May 26 15:02:30.316690 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c85f4fd8-0e7d-4881-b72e-e7a0500608db,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:30.317417 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33102) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:30.323715 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:30.350333 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.389206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.418369 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.428851 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.430027 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /v2.0/floatingips/f6d82bda-ca13-43e4-aa88-cfcb9153aeaa HTTP/1.1" status: 204  len: 168 time: 0.9827909
May 26 15:02:30.542956 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.548247 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-565e4157-7918-4a0c-b764-163c5d82a140 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:30.559917 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c85f4fd8-0e7d-4881-b72e-e7a0500608db,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:30.563322 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:30.565250 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.566466 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9f8f550e-f376-4c81-a9e9-0eb2c4698620 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c85f4fd8-0e7d-4881-b72e-e7a0500608db HTTP/1.1" status: 204  len: 168 time: 0.2446940
May 26 15:02:30.875084 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33116) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:30.880877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1315006637', 'description': 'tempest-description--1472410275'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:30.886676 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:30.891289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:30.894257 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:30.903303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:30.977675 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:30.999244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:31.003100 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:31.005907 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:31.011550 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:31.085010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.200154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.206672 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-65aa154e-7045-4a9b-873b-c38b5dfd8bfa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:31.254634 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroup': ['ID=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:31.257352 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:31.292672 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33128) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:31.310613 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.325399 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:31.330213 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Usage tracker for resource:security_group_rule and tenant:6221fc7882074e228b8e13cfabf1ae96 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:31.334164 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:31.341123 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:31.357694 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.359108 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.4825373
May 26 15:02:31.362163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33132) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:31.367513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group_rule': {'security_group_id': '863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:31.373221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:31.377965 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:31.380996 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:31.387052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:31.463836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.527821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.533825 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.594348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.594590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.596435 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b660481a-3e4e-47ed-b3fa-bc03723b61d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:31.603750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-65af818e-6d05-4b3a-b4d4-78085609d315 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:31.621116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=014ae253-cba6-438e-999f-29e3f9fb82ed,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:31.626952 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:31.645924 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=6221fc7882074e228b8e13cfabf1ae96&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3521376
May 26 15:02:31.647543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7eabbfec-db2c-49ac-9809-28a5a9a8ece4,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:31.650367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33136) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:31.650778 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:31.694836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.695989 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3327236
May 26 15:02:31.698862 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33140) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:31.704514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'security_group_rule': {'security_group_id': '863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:31.710530 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:31.714303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:security_group_rule and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:31.717296 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:31.719744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.724105 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:31.746411 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.811284 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.871093 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.874804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.879543 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:31.891187 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7eabbfec-db2c-49ac-9809-28a5a9a8ece4,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:31.894091 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:31.896239 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.899826 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0d20b428-ff9b-4458-bd7c-126c865eeae9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/7eabbfec-db2c-49ac-9809-28a5a9a8ece4 HTTP/1.1" status: 204  len: 168 time: 0.2454736
May 26 15:02:31.988785 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:31.990988 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0f2391de-72ea-460c-9a3c-1915760413e3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:32.012517 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bd1ba6b-be3e-4332-9ee5-5afce7d2ff52,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:32.016784 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:32.143263 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:32.146328 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0753782f-4916-42f1-ad9a-4b9a0d98de03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4446168
May 26 15:02:32.148569 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33150) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:32.154127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:32.160629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:32.164372 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Usage tracker for resource:floatingip and tenant:7555f6895a2a405685d8ccfe81fe5a74 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:32.167208 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:32.173466 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:32.257632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:32.411840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:32.578206 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Allocated IP 172.27.2.125 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/6f8c2a86-05f6-42d1-8c09-8a406f00d116) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:32.735126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:32.858141 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:32.865374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22828d5a-d2de-4d72-b402-a20436eb2c30 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:32.926551 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:32.929908 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:32.932356 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:32.990055 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=6f8c2a86-05f6-42d1-8c09-8a406f00d116,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:32.992856 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:33.164135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.286006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.491430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.554464 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.559319 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:33.739753 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=6f8c2a86-05f6-42d1-8c09-8a406f00d116,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:33.742821 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:33.750675 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.840082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:33.849495 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.6919162
May 26 15:02:34.315022 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-6393e33d-1af2-4675-8cc4-45a9596bd3df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:34.371589 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-6393e33d-1af2-4675-8cc4-45a9596bd3df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:34.372785 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-6393e33d-1af2-4675-8cc4-45a9596bd3df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1315006637&fields=id&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 267 time: 0.0993426
May 26 15:02:34.530941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-f823b733-7d89-4c8c-bc0e-06945d697c36 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:34.532351 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-f823b733-7d89-4c8c-bc0e-06945d697c36 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 817 time: 0.1527972
May 26 15:02:34.548079 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-74e30d07-d46e-4a4b-a3c9-d5d05e6dbc6a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/quotas/7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 375 time: 0.0101175
May 26 15:02:34.632232 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-691716c3-0809-482d-9232-3c4e216a874b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0789742
May 26 15:02:34.772994 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-13ae1169-845b-4ec0-8383-189ae3908423 service neutron] 10.222.0.81 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1283627
May 26 15:02:34.834234 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33232) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:34.906204 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-8ab97d7a-b086-4a0e-ac43-f7309e06c089 service neutron] 10.222.0.81 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1263196
May 26 15:02:34.971155 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:34.989279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:34.993912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Usage tracker for resource:security_group_rule and tenant:d1b2bbb5eb8a4c25a5aff978ccd88501 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:34.999454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:35.003851 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:35.092462 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.194587 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.211657 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db6561fa-8505-4b02-bf80-2e166d76a145 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:35.255757 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d1b2bbb5eb8a4c25a5aff978ccd88501&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4203722
May 26 15:02:35.258186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33260) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:35.274953 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5df4dc93-7964-4672-b2cc-be1eeea5c256,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:35.299501 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:35.382081 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 req-3d883745-bff6-4afb-a44d-88cee4dfacd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:35.385750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.417666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.491786 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 req-3d883745-bff6-4afb-a44d-88cee4dfacd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:35.493098 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 req-3d883745-bff6-4afb-a44d-88cee4dfacd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 210 time: 0.3458385
May 26 15:02:35.537341 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.542898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:35.557187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5df4dc93-7964-4672-b2cc-be1eeea5c256,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:35.562828 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:35.590155 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5df4dc93-7964-4672-b2cc-be1eeea5c256 HTTP/1.1" status: 204  len: 168 time: 0.3304377
May 26 15:02:35.598285 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:36.347657 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33292) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:36.372752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.394918 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:36.401480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Usage tracker for resource:security_group_rule and tenant:f6a5cc65f7a7465cb616221a54c04e53 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:36.406264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:36.413281 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:36.510018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.562129 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.578509 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-23de0710-252b-4a0c-aad9-e61a4f5cd33d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:36.634443 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f6a5cc65f7a7465cb616221a54c04e53&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2856655
May 26 15:02:36.636943 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb57cfdc-811c-45fd-8527-17f9beb0972d,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:36.637124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33302) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:36.642252 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:36.733673 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc req-c3e05657-881e-4c22-aa54-d6547c15fc75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 210 time: 0.0661023
May 26 15:02:36.754531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.791688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.920328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.925500 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d34a1273-cdee-4191-bd8f-8fb1c817feac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:36.937942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb57cfdc-811c-45fd-8527-17f9beb0972d,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:36.942205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:36.956512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:36.962236 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-25ed5ad2-2cd0-4f1d-bc5f-78077445f3cd admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/bb57cfdc-811c-45fd-8527-17f9beb0972d HTTP/1.1" status: 204  len: 168 time: 0.3241224
May 26 15:02:37.603966 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-409b30bc-5725-4d48-993d-cc9184aad469 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:37.605393 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-409b30bc-5725-4d48-993d-cc9184aad469 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 817 time: 0.2096291
May 26 15:02:37.620825 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 req-a3ed25f4-5f66-4234-9627-d9a11e42c527 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:37.622312 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 req-a3ed25f4-5f66-4234-9627-d9a11e42c527 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.1443202
May 26 15:02:37.697429 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-d9efc11a-04b9-4fdd-b361-f0667968eddc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 380 time: 0.0741670
May 26 15:02:37.702489 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 req-fcb3eced-e1f2-4185-a335-c195feb96a87 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657485
May 26 15:02:37.707186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'port': {'device_id': '757c7def-93df-481f-b40d-7115f4bbbefe', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'admin_state_up': True, 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'security_groups': ['863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:37.765160 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33326) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:37.789665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:37.810154 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:37.829733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Usage tracker for resource:security_group_rule and tenant:8f7aa7f73525496a86328cad004142cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:37.834180 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:37.841411 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:37.863547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:37.873523 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:37.918160 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 req-daaede1a-29f4-4d00-88d4-dcdb9dd16599 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 210 time: 0.0573344
May 26 15:02:37.974265 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.034006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Made reservation on behalf of 7555f6895a2a405685d8ccfe81fe5a74 for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:38.037570 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.080063 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.088710 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c5ffa2d6-20d4-4b98-b7d5-662042800d88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:38.133279 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=8f7aa7f73525496a86328cad004142cc&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3659015
May 26 15:02:38.135961 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33338) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:38.139420 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f8868774-1da2-4953-8889-15bec58d86d2,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:38.153779 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:38.206769 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.209186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Allocated IP 172.20.0.5 (c010dc4d-023b-4979-a482-d3b3e0924e91/09a19960-7788-4d46-a08e-92c63f201983/d9f82690-b757-4c6f-b288-d20d193f4031) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:38.233942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.352900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33346) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:38.403137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.409727 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-35228a1c-5d80-4fb9-ad5d-1242ffd81e23 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:38.427406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f8868774-1da2-4953-8889-15bec58d86d2,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:38.434584 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:38.441089 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Deleting subnet bdad3913-e712-409a-9b8b-ccdccd8ad915 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:02:38.444460 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.445597 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/f8868774-1da2-4953-8889-15bec58d86d2 HTTP/1.1" status: 204  len: 168 time: 0.3085337
May 26 15:02:38.446446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.501014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.506571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.517409 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Transition to ACTIVE for port object d9f82690-b757-4c6f-b288-d20d193f4031 will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:38.566560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.641135 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.646730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:38.712010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Network c010dc4d-023b-4979-a482-d3b3e0924e91 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:38.715003 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:38.719642 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:38.760188 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:38.769279 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:38.805357 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:38.806101 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:38.930254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 req-7f4a4de1-3f5f-4aab-9878-149be84a555b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:38.932195 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 req-7f4a4de1-3f5f-4aab-9878-149be84a555b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0917499
May 26 15:02:38.934071 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2306840
May 26 15:02:38.963103 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Request body: {'port': {'device_id': '757c7def-93df-481f-b40d-7115f4bbbefe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:39.000258 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.015985 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1422103c-5791-451d-a876-8f3e90670445 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:39.037382 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 req-934b9eff-f74e-42f3-b3db-4de63b1602e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0977840
May 26 15:02:39.070534 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.078658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bdad3913-e712-409a-9b8b-ccdccd8ad915,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:39.082044 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:39.083932 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b9bb749c-bfd8-4632-877d-d898e76230ad admin admin] 10.222.0.81 "DELETE /v2.0/subnets/bdad3913-e712-409a-9b8b-ccdccd8ad915 HTTP/1.1" status: 204  len: 168 time: 0.7298627
May 26 15:02:39.094800 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33366) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:39.120574 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c7c533a4-db08-48e3-a3af-240d17a1ad89 None None] Provisioning for port d9f82690-b757-4c6f-b288-d20d193f4031 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:39.127096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c7c533a4-db08-48e3-a3af-240d17a1ad89 None None] Provisioning complete for port d9f82690-b757-4c6f-b288-d20d193f4031 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:39.128460 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c7c533a4-db08-48e3-a3af-240d17a1ad89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.183411 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 req-c3d1c010-9a02-4b02-9978-50a06025da63 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:39.184705 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 req-c3d1c010-9a02-4b02-9978-50a06025da63 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 931 time: 0.0948551
May 26 15:02:39.192025 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-c7c533a4-db08-48e3-a3af-240d17a1ad89 None None] Port d9f82690-b757-4c6f-b288-d20d193f4031 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:02:39.210381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.238872 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 req-d3e1fc2c-62c5-496d-8611-be33abf74028 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:39.250698 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 req-d3e1fc2c-62c5-496d-8611-be33abf74028 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:39.251884 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 req-d3e1fc2c-62c5-496d-8611-be33abf74028 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0605478
May 26 15:02:39.284411 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.385762 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-aaf04a7c-8339-4435-b382-78b77c1d1024 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:39.387386 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-aaf04a7c-8339-4435-b382-78b77c1d1024 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.0837400
May 26 15:02:39.505912 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.537734 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Deleting port 5b77d4a0-1161-49af-829e-9c8b577a215a {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:02:39.537734 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.540318 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcabf3e9c70>,) {'filters': {'network_id': ['9f5bc9eb-1964-454a-a177-4bdcfc4e0298']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:39.610552 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcabf3e9c70>, '324ba4e6-313b-4b92-81fd-29df319c25e1') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:39.610863 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcabf3e9c70>, '324ba4e6-313b-4b92-81fd-29df319c25e1') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:39.628119 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.658691 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.670354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Releasing vlan 1220 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:02:39.670780 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:02:39.684632 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:02:39.694730 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] For port 5b77d4a0-1161-49af-829e-9c8b577a215a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5b77d4a0-1161-49af-829e-9c8b577a215a,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:39.697312 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.759390 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33384) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:39.869400 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:02:39.878293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.882949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.890963 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:39.902337 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-677153450-network', 'tenant_id': '83937b4f3831489289cd8aec97222f77'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:39.912390 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:39.936833 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Pushing event deleted for resources: {'Network': ['ID=9f5bc9eb-1964-454a-a177-4bdcfc4e0298,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:39.939355 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:39.941840 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:39.951583 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Usage tracker for resource:network and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:39.956311 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:39.959516 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Transition to ACTIVE for port object d9f82690-b757-4c6f-b288-d20d193f4031 will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:39.963804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:40.006906 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2d77a7d6-838e-4936-9075-d7a5e22abb47 admin admin] 10.222.0.81 "DELETE /v2.0/networks/9f5bc9eb-1964-454a-a177-4bdcfc4e0298 HTTP/1.1" status: 204  len: 168 time: 0.9110451
May 26 15:02:40.057911 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Made reservation on behalf of 83937b4f3831489289cd8aec97222f77 for: {'network': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:40.061012 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.070611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.076582 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:40.108691 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.109760 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.112417 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Floating IP 3908a854-dbfa-4dc7-a191-1a903dc01b81 disassociated. External IP: 172.27.2.43, port: 5b77d4a0-1161-49af-829e-9c8b577a215a.
May 26 15:02:40.112417 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling delete_port for 5b77d4a0-1161-49af-829e-9c8b577a215a owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:02:40.123432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.255374 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:40.269776 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:40.272457 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:40.279195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:40.279195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:40.314908 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:40.326519 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.341969 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:40.402107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'Port': ['ID=5b77d4a0-1161-49af-829e-9c8b577a215a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:40.406110 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:40.450748 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c req-4d190d64-d028-4af4-9254-9826fa6da660 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:40.452354 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c req-4d190d64-d028-4af4-9254-9826fa6da660 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 945 time: 0.2504849
May 26 15:02:40.454739 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33398) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:40.477391 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Attempting to bind port d9f82690-b757-4c6f-b288-d20d193f4031 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:40.477672 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Attempting to bind port d9f82690-b757-4c6f-b288-d20d193f4031 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:40.477995 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Attempting to bind port d9f82690-b757-4c6f-b288-d20d193f4031 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:40.511446 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Port d9f82690-b757-4c6f-b288-d20d193f4031 on network c010dc4d-023b-4979-a482-d3b3e0924e91 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:02:40.511774 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Attempting to bind port d9f82690-b757-4c6f-b288-d20d193f4031 on network c010dc4d-023b-4979-a482-d3b3e0924e91 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:40.634767 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:40.635101 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Checking segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:40.635490 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Bound using segment: {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:40.635922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Bound port: d9f82690-b757-4c6f-b288-d20d193f4031, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e16500c6-bc20-4512-be7a-ff27e5886c30', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1224, 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:40.636268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.667826 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 req-4e3c2fe8-5b92-4dff-a8a0-9cfcf749b4ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:40.669283 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 req-4e3c2fe8-5b92-4dff-a8a0-9cfcf749b4ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.2707703
May 26 15:02:40.682476 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:02:40.727785 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-ff32582c-9d48-4f0f-b612-c4d93e44b106 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=5b729993a1944061bb0a708877c95a5c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2682214
May 26 15:02:40.739560 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c req-da9d5f4f-5291-442f-9d5c-956ccd033a7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=0219a3bc-1111-4434-925e-612ae7df5982&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2633185
May 26 15:02:40.746264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33402) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:40.792083 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.794150 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 req-8ed7d940-aff3-46cb-8971-eb15a72f0233 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1156094
May 26 15:02:40.841094 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:40.845571 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:40.860949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.863923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8f7c8df6-7cd6-4b02-b4c1-b942611bec82 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:40.870782 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.912375 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.919286 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:40.925377 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1205}  {{(pid=103981) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 15:02:40.932550 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:40.934783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c346a6a-0742-44bc-b430-b584c9e11507,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:40.940095 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.948222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:40.951694 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.028s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:40.960306 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:40.961145 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2910>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:40.990814 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:40.991426 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:40.992804 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] 10.222.0.32 "PUT /v2.0/ports/d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 1093 time: 2.0368695
May 26 15:02:41.000026 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:41.020131 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] No DVR routers for this DVR port 5b77d4a0-1161-49af-829e-9c8b577a215a on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:02:41.022283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.022631 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.segments_db [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Added segment 293b87b4-e7d6-44df-8223-0904a6af3b0e of type vlan for network 91d594ee-93aa-497d-af26-3f3353865830
May 26 15:02:41.025105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.038729 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'name': 'network-vif-deleted', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:41.115801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.120231 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9d8f9a6-bd66-4caa-8662-4bb94655ae59', 'name': 'network-vif-deleted', 'tag': '5b77d4a0-1161-49af-829e-9c8b577a215a', 'status': 'completed', 'code': 200}
May 26 15:02:41.123052 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'status': 'completed', 'code': 200}
May 26 15:02:41.138425 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e10d2c9b-6815-4c9a-9646-f73ea9254faa req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "DELETE /v2.0/ports/5b77d4a0-1161-49af-829e-9c8b577a215a HTTP/1.1" status: 204  len: 173 time: 1.7446771
May 26 15:02:41.146473 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:41.191533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.240s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:41.262038 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:41.276848 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-a3af282f-55e8-4bb5-a607-34d310332474 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:41.278707 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-a3af282f-55e8-4bb5-a607-34d310332474 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1096 time: 0.1541545
May 26 15:02:41.318371 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.375973 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-4d33ab02-d3e1-45dc-9bb9-b2ec51935038 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:41.396801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.408610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:41.409181 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.412658 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63b52cba-73eb-4a19-a99c-4bdf00795972,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:41.428892 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:41.435539 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fd30a2ca-0087-4cc9-87f0-678598c34793 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.009s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:41.554466 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.558169 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/63b52cba-73eb-4a19-a99c-4bdf00795972 HTTP/1.1" status: 204  len: 168 time: 0.8068814
May 26 15:02:41.570818 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-2ec21676-7141-4df9-972d-e791ef8152f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:41.572279 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-2ec21676-7141-4df9-972d-e791ef8152f4 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&shared=False HTTP/1.1" status: 200  len: 919 time: 0.2861588
May 26 15:02:41.576509 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Pushing event updated for resources: {'Network': ['ID=91d594ee-93aa-497d-af26-3f3353865830,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:41.588483 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 91d594ee-93aa-497d-af26-3f3353865830 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 15:02:41.605520 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:41.673705 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 1.9132156
May 26 15:02:41.677086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33416) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:41.683102 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Request body: {'subnet': {'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-677153450-subnet', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:41.688432 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:41.692284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Usage tracker for resource:subnet and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:41.695669 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:41.701103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:41.713931 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2910>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:41.719107 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:41.728823 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:41.729444 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2910>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:41.749797 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0523afa4-13ae-4f5a-bc3b-61de8dc05764 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:41.751411 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0523afa4-13ae-4f5a-bc3b-61de8dc05764 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1720684
May 26 15:02:41.806242 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Made reservation on behalf of 83937b4f3831489289cd8aec97222f77 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:41.808874 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:41.953078 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3046d32d-e642-4d20-94b5-a6df2717a82a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:41.971048 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-3046d32d-e642-4d20-94b5-a6df2717a82a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1096 time: 0.1696038
May 26 15:02:42.049182 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:42.153022 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 req-e9bfbe53-7209-4463-b4aa-e5aad5e0221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=a9d8f9a6-bd66-4caa-8662-4bb94655ae59 HTTP/1.1" status: 200  len: 210 time: 0.1809459
May 26 15:02:42.210704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57635357-7565-46a9-b114-99d1b9712c82 req-678a8adc-acf1-40f0-bbfd-7fb543caa767 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:42.213002 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-57635357-7565-46a9-b114-99d1b9712c82 req-678a8adc-acf1-40f0-bbfd-7fb543caa767 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.2042773
May 26 15:02:42.250446 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-ed779717-4d08-4cc8-b5f1-f76f16c24735 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 217 time: 0.0961306
May 26 15:02:42.274245 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-57635357-7565-46a9-b114-99d1b9712c82 req-a5ad4658-c6f9-4c1c-a2ce-a004d2049fc6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0497160
May 26 15:02:42.321231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-0d1cd3f6-ae35-4cfe-8798-b4444afcec47 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:42.322693 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-0d1cd3f6-ae35-4cfe-8798-b4444afcec47 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0657232
May 26 15:02:42.393333 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5b77d4a0-1161-49af-829e-9c8b577a215a no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:02:42.399730 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-74a3fe8b-1017-4298-ace5-50da7b2bc1ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:42.401206 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-74a3fe8b-1017-4298-ace5-50da7b2bc1ef service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0719266
May 26 15:02:42.475200 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 5b77d4a0-1161-49af-829e-9c8b577a215a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:02:42.475554 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5b77d4a0-1161-49af-829e-9c8b577a215a not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:02:42.509662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:42.515944 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:42.543328 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-68c304bb-a678-49ff-9bc0-0040caca9862 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1347158
May 26 15:02:42.548865 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46e2910>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:42.553782 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c409e7e5-5a25-4648-93d7-985f3fb50e4f None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:42.593570 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6bf4d059-576f-4ff2-9b19-4983cc253018,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:42.598119 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:42.604282 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Checking segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:42.604626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Network hostable DHCP agents. Network: 91d594ee-93aa-497d-af26-3f3353865830, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 15:02:42.686493 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Network 91d594ee-93aa-497d-af26-3f3353865830 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 15:02:42.689312 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 req-310fd404-0db1-4842-96f9-fe61afe2cb04 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1389971
May 26 15:02:42.749265 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 91d594ee-93aa-497d-af26-3f3353865830) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:42.758328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:42.758871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46da5a15-cc9d-4f22-974a-98dd9fdb20cc None None] Network 91d594ee-93aa-497d-af26-3f3353865830 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:02:42.759134 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:42.792445 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c65db8a9-9a87-4dfb-949d-e03f73a0eeb4 None None] New status for floating IP 3908a854-dbfa-4dc7-a191-1a903dc01b81: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:02:42.833981 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 1.1518500
May 26 15:02:42.834301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33428) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:42.839906 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:42.845326 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:42.849845 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Usage tracker for resource:router and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:42.852962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:42.860074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:42.949052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:42.950249 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:42.966006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:42.977693 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-91d594ee-93aa-497d-af26-3f3353865830', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 15:02:42.978869 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.136311 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Allocated IP 172.20.0.2 (91d594ee-93aa-497d-af26-3f3353865830/6bf4d059-576f-4ff2-9b19-4983cc253018/7d798e60-1ff9-40dd-a32e-991b01fbe25d) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:43.362443 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.374426 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Transition to ACTIVE for port object 7d798e60-1ff9-40dd-a32e-991b01fbe25d will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:43.391105 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33442) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:43.402129 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Transition to ACTIVE for port object 7d798e60-1ff9-40dd-a32e-991b01fbe25d will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:43.432514 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.456204 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.461234 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:43.523697 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.557174 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Network 91d594ee-93aa-497d-af26-3f3353865830 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:43.561140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:43.564543 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:43.565417 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.568086 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Pushing event updated for resources: {'Port': ['ID=7d798e60-1ff9-40dd-a32e-991b01fbe25d,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:43.581442 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28be4033-a32a-4819-b816-8e3f6dccd1a4 req-6f2d65f6-51c6-40f0-96e8-5a34a90ac303 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:43.582542 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-28be4033-a32a-4819-b816-8e3f6dccd1a4 req-6f2d65f6-51c6-40f0-96e8-5a34a90ac303 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:43.606390 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.606734 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.607073 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.607405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.607730 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.608671 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.609114 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.609633 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.609973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.610295 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.610610 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.610930 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:43.615249 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:43.672917 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Attempting to bind port 7d798e60-1ff9-40dd-a32e-991b01fbe25d on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:43.673299 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Attempting to bind port 7d798e60-1ff9-40dd-a32e-991b01fbe25d by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:43.673709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Attempting to bind port 7d798e60-1ff9-40dd-a32e-991b01fbe25d on network 91d594ee-93aa-497d-af26-3f3353865830 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:43.679465 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:43.679779 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Checking segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:43.680094 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.680490 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Bound using segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:43.680964 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Bound port: 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:43.681341 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.682047 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-28be4033-a32a-4819-b816-8e3f6dccd1a4 req-6f2d65f6-51c6-40f0-96e8-5a34a90ac303 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:43.684221 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28be4033-a32a-4819-b816-8e3f6dccd1a4 req-6f2d65f6-51c6-40f0-96e8-5a34a90ac303 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.2737272
May 26 15:02:43.709243 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.716319 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-752c1f54-2c08-4ba6-9856-091ad564a0a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:43.784367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] For port 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:43.788150 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] For port 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d798e60-1ff9-40dd-a32e-991b01fbe25d,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:43.832438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.835222 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.840688 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:43.847387 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0219a3bc-1111-4434-925e-612ae7df5982,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:43.852234 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:43.860371 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-28be4033-a32a-4819-b816-8e3f6dccd1a4 req-5248b333-48e7-4b11-bd5b-02a56b9c1ec2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1701527
May 26 15:02:43.863594 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.918809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:43.923337 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /v2.0/security-groups/0219a3bc-1111-4434-925e-612ae7df5982 HTTP/1.1" status: 204  len: 168 time: 0.5306759
May 26 15:02:43.924073 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33446) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:43.942553 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.api.v2.resource [None req-136ea719-3d7b-485e-a7a7-9c6f4989fc3b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] show failed (client error): The resource could not be found.
May 26 15:02:43.946891 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-136ea719-3d7b-485e-a7a7-9c6f4989fc3b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups/0219a3bc-1111-4434-925e-612ae7df5982 HTTP/1.1" status: 404  len: 347 time: 0.0216632
May 26 15:02:43.947616 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33450) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:43.952019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Pushing event updated for resources: {'Port': ['ID=7d798e60-1ff9-40dd-a32e-991b01fbe25d,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:43.962649 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:44.064464 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Allocated IP 172.27.2.22 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:44.216653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Deleting port 5098d580-480b-43e1-a701-6a9a07ee4be8 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:02:44.216653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.282015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.352320 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.352650 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.383534 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.388320 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f4e8224f-eb0d-47e3-88ec-72af779cec6f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:44.401043 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:02:44.449770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:44.453566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:44.457699 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:44.487777 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling delete_port for 5098d580-480b-43e1-a701-6a9a07ee4be8 owned by network:floatingip {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:02:44.499738 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Pushing event updated for resources: {'Port': ['ID=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:44.508725 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:44.552927 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:44.566798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:02:44.622936 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.640318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:02:44.657336 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:44.708993 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.714173 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3bf97fc1-4b73-491f-8896-7052a971d93b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:44.720121 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.722009 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:44.760850 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'Port': ['ID=5098d580-480b-43e1-a701-6a9a07ee4be8,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:44.790264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:44.799212 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:44.802903 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:44.864863 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.882256 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:44.886026 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /v2.0/floatingips/3908a854-dbfa-4dc7-a191-1a903dc01b81 HTTP/1.1" status: 204  len: 168 time: 0.9348073
May 26 15:02:45.035778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b47ce7-a621-420b-8674-c45709b55148 None None] Network 91d594ee-93aa-497d-af26-3f3353865830 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:02:45.153785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.195409 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d798e60-1ff9-40dd-a32e-991b01fbe25d up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:45.261057 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec47736-01d5-47af-909c-4156db07c441 req-7580b9af-309e-4efe-9c77-e7b836d7ca2c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:45.268124 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bec47736-01d5-47af-909c-4156db07c441 req-7580b9af-309e-4efe-9c77-e7b836d7ca2c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.2243228
May 26 15:02:45.391940 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bec47736-01d5-47af-909c-4156db07c441 req-3fd0d674-d587-4c03-b899-79ad58db8ce8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1228878
May 26 15:02:45.393080 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f1b12d31-98fc-4044-b0fe-65efd26271d2 None None] Provisioning for port 7d798e60-1ff9-40dd-a32e-991b01fbe25d completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:45.491625 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 7d798e60-1ff9-40dd-a32e-991b01fbe25d completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:45.496671 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7d798e60-1ff9-40dd-a32e-991b01fbe25d triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:45.497042 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.597393 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.620710 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33464) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:45.629695 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1771820736', 'description': 'tempest-description--1163946835'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:45.640875 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:45.643185 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.644437 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:45.647590 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:45.654149 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:45.675961 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d798e60-1ff9-40dd-a32e-991b01fbe25d,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:45.724882 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-0516831e-ef5d-4e5a-b72c-55c75e980c25 None None] Provisioning complete for port 7d798e60-1ff9-40dd-a32e-991b01fbe25d triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:45.725472 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0516831e-ef5d-4e5a-b72c-55c75e980c25 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.726038 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.746698 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:45.751182 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:45.754164 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:45.759984 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:45.765118 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.774615 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:45.840218 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.863103 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=7d798e60-1ff9-40dd-a32e-991b01fbe25d,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:45.866816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:45.880148 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Router 5f218ea9-44ea-4266-9fc8-01161ec57870 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 15:02:45.914685 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:45.920050 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:45.960757 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9f4f2011-11f2-4842-b93a-4f7e6c181dfc,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:45.963523 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:46.028923 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.030862 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.4089460
May 26 15:02:46.033696 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33468) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:46.038783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group_rule': {'security_group_id': '9f4f2011-11f2-4842-b93a-4f7e6c181dfc', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:46.044460 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:46.048278 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:46.051276 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:46.056998 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:46.063414 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:46.072069 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Sync routers for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:46.082069 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:46.082696 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4714c10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:46.143885 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.148919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.153007 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 925 time: 3.3152010
May 26 15:02:46.153267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33472) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:46.261193 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:46.350653 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.427487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.445358 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:46.482944 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e88546a1-5075-4cec-b0d4-a1a48db96395,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:46.486518 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:46.558032 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4714c10>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:44Z', 'revision_number': 3, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:46.562669 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Checking router: 5f218ea9-44ea-4266-9fc8-01161ec57870 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:46.563026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Updating router 5f218ea9-44ea-4266-9fc8-01161ec57870 port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:02:46.566382 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.569461 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2832f1a9-0d62-4c17-ab25-7692caa6d5ee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5329678
May 26 15:02:46.570296 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33480) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:46.577797 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'security_group_rule': {'security_group_id': '9f4f2011-11f2-4842-b93a-4f7e6c181dfc', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:46.585171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:46.591533 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:security_group_rule and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:46.596623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:46.604992 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:46.607758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a req-7408323d-42ac-4675-b6ea-09a0a1da5b17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:46.609881 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a req-7408323d-42ac-4675-b6ea-09a0a1da5b17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.0908854
May 26 15:02:46.625083 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.657721 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a req-24e73cb4-b1b9-43f9-88bc-b9d081872124 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402308
May 26 15:02:46.882223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.959716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:46.971793 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Transition to ACTIVE for port object ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:47.030549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.047012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.057559 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-df368be3-f46f-445d-a42e-c3aba01b03dc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:47.111227 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d798e60-1ff9-40dd-a32e-991b01fbe25d up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:47.113884 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.129949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.137895 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:47.176206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Attempting to bind port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:47.176573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Attempting to bind port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:47.176937 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Attempting to bind port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:47.188144 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Pushing event updated for resources: {'Port': ['ID=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:47.194966 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:47.197358 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:47.197799 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:47.198201 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.198592 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:47.199067 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Bound port: ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:47.199438 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.205649 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cbe4c680-c173-4399-89db-f259b08d7f3c,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:47.214768 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:47.273633 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 7d798e60-1ff9-40dd-a32e-991b01fbe25d triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:47.274001 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.287884 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.289174 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-84874caa-82f9-4827-a5e3-158680549b24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.7179527
May 26 15:02:47.292367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33484) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:47.298323 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:47.304843 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:47.308665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Usage tracker for resource:floatingip and tenant:81e8cac36a174b2eb5a6e53fdf25b4cc is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:47.311840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:47.321279 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] For port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:47.325408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:47.363215 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] For port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:47.375418 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Allocated IP 172.20.0.1 (91d594ee-93aa-497d-af26-3f3353865830/6bf4d059-576f-4ff2-9b19-4983cc253018/e1b444e0-d083-4f15-a3d0-2a82bf7344cc) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:47.412127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.452661 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.458412 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:47.536947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:47.537751 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4714c10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:47.565220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.571327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.581860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Transition to ACTIVE for port object e1b444e0-d083-4f15-a3d0-2a82bf7344cc will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:47.613861 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Pushing event updated for resources: {'Port': ['ID=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:47.619295 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:47.681446 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.687790 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ca3a1164-c632-4c0b-8bc5-42f47410dc65 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:47.728226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Allocated IP 172.27.2.230 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/f9565832-6c56-40c9-b714-05a99b72fea3) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:47.736152 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:47.757396 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Network 91d594ee-93aa-497d-af26-3f3353865830 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:47.760427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:47.765090 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:47.787754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['d9f82690-b757-4c6f-b288-d20d193f4031'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:02:47.817262 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Pushing event updated for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:47.825785 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:47.901352 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:47.913718 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.034969 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.041197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-59a25527-4fd4-4f3e-bc68-546934c43566 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:48.063604 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab97f986-00dd-4a98-83fc-55e6d47beb75 req-257d4d8e-94b6-45a8-a90e-31e5dda4298f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:48.065036 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ab97f986-00dd-4a98-83fc-55e6d47beb75 req-257d4d8e-94b6-45a8-a90e-31e5dda4298f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.2383301
May 26 15:02:48.141760 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ab97f986-00dd-4a98-83fc-55e6d47beb75 req-df093156-7f0a-4fa0-a6c2-f778dcfffdf1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0673370
May 26 15:02:48.196958 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6628a426-63f6-46bd-8a10-5c8a33a20fbf None None] Provisioning for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:48.204303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:48.207299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:48.210919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:48.211300 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-6628a426-63f6-46bd-8a10-5c8a33a20fbf None None] Provisioning complete for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:48.211702 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6628a426-63f6-46bd-8a10-5c8a33a20fbf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.245402 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=f9565832-6c56-40c9-b714-05a99b72fea3,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:48.254695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:48.299922 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.311924 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-6628a426-63f6-46bd-8a10-5c8a33a20fbf None None] Port e1b444e0-d083-4f15-a3d0-2a82bf7344cc cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:02:48.312584 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.327914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4714c10>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:44Z', 'revision_number': 3, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:48.331852 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-919a207b-099b-44d3-ae0d-1bc15d89614e None None] The sync data for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi is: [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:44Z', 'revision_number': 3, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:48.413916 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.599323 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.668537 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.670977 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.699315 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-10fd0e5c-8ff7-4923-985a-5462a356ea46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:48.725471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.730901 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a33aaa17-b88e-4c7e-8af1-192f66e2147c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:48.835255 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:48.835255 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Pushing event updated for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:48.835255 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:48.841122 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=f9565832-6c56-40c9-b714-05a99b72fea3,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:48.847237 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:48.875732 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.047279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.047279 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 1.7489190
May 26 15:02:49.123699 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Network 91d594ee-93aa-497d-af26-3f3353865830 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:49.125327 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:49.169410 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:49.360479 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:49.367962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:49.367962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.509943 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Router 5f218ea9-44ea-4266-9fc8-01161ec57870 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:02:49.537508 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 req-36992ec6-eee7-4f7d-a249-99dc24b73216 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:49.539116 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 req-36992ec6-eee7-4f7d-a249-99dc24b73216 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.1564677
May 26 15:02:49.593860 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.611875 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:49.613091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-42198ecd-a1c1-4861-8eb2-5df088ccab24 None None] Provisioning complete for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:49.613514 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-42198ecd-a1c1-4861-8eb2-5df088ccab24 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.615865 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 req-7168b3b8-8f0b-44b2-8b7f-80a16d7016ad tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0649893
May 26 15:02:49.677069 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:49.685366 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:49.711610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-37090612-c4e3-4916-9c93-abf8dee65881 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:49.718995 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-42198ecd-a1c1-4861-8eb2-5df088ccab24 None None] Port e1b444e0-d083-4f15-a3d0-2a82bf7344cc cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:02:49.752963 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:49.755991 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:49.765443 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:49.776861 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] 10.222.0.81 "PUT /v2.0/routers/5f218ea9-44ea-4266-9fc8-01161ec57870/add_router_interface HTTP/1.1" status: 200  len: 503 time: 3.6160810
May 26 15:02:49.828786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-37090612-c4e3-4916-9c93-abf8dee65881 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:49.830815 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-37090612-c4e3-4916-9c93-abf8dee65881 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-securitygroup--1771820736&fields=id&tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 267 time: 0.2428005
May 26 15:02:50.010270 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-68672937-af28-4be8-86bf-09b93ba5daae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:50.011982 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-68672937-af28-4be8-86bf-09b93ba5daae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 810 time: 0.1664705
May 26 15:02:50.034546 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-1cd88d93-b675-4720-bcd6-149fc0097b85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/quotas/81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 375 time: 0.0157762
May 26 15:02:50.125488 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-444373ad-dc22-4432-a1c3-28d1abf61c03 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:50.211458 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-444373ad-dc22-4432-a1c3-28d1abf61c03 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:50.216565 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-444373ad-dc22-4432-a1c3-28d1abf61c03 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1728232
May 26 15:02:50.231284 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Sync routers for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:50.242445 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:50.243149 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4ce2190>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:50.416105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:50.428874 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:50.482228 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-8225fbe7-15bb-4daa-8f73-68d76b707572 service neutron] 10.222.0.81 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2556047
May 26 15:02:50.561337 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cd63e513-4fb9-4e7f-acb2-3026871a7bad None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.590016 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port d9f82690-b757-4c6f-b288-d20d193f4031 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:50.597475 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port d9f82690-b757-4c6f-b288-d20d193f4031 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:50.598753 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.637248 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-3703f36e-63e6-4637-90fd-7e431bb07cb6 service neutron] 10.222.0.81 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1461763
May 26 15:02:50.647430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33542) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:50.661774 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1829784076-network', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:50.672066 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:50.680103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Usage tracker for resource:network and tenant:298f387c22874d8cbf8b86ab642c6bc1 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:50.690893 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:50.704690 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:50.764634 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.801720 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:50.806654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Made reservation on behalf of 298f387c22874d8cbf8b86ab642c6bc1 for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:50.810864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.811679 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:50.833676 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.845398 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4ce2190>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 2, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:50.849860 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Checking router: 5f218ea9-44ea-4266-9fc8-01161ec57870 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:50.850206 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Updating router 5f218ea9-44ea-4266-9fc8-01161ec57870 port e1b444e0-d083-4f15-a3d0-2a82bf7344cc binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:02:50.862308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:50.868903 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Usage tracker for resource:security_group_rule and tenant:298f387c22874d8cbf8b86ab642c6bc1 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:50.881017 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e req-b2e4a305-8c99-4abd-9caf-8f0ab1ef7a6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:50.882940 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e req-b2e4a305-8c99-4abd-9caf-8f0ab1ef7a6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.1461732
May 26 15:02:50.884078 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:50.889324 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.891783 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:50.895408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:50.924514 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:50.981989 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e req-74f81dfd-2668-40ac-a130-34bb43f76132 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0890164
May 26 15:02:50.998555 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:51.004356 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:51.007924 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'code': 200}
May 26 15:02:51.080869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.137345 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.143819 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:51.153050 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1203}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 15:02:51.168637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.168637 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Added segment df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6 of type vlan for network eea6c2fb-29bc-4ead-92f8-0304ed714d21
May 26 15:02:51.196170 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ead24682-109f-4525-b2c4-7ea99aff36cb req-5ceb1864-880e-474c-974b-dbf2778eefa1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.1106281
May 26 15:02:51.207648 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.243053 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-62bc0242-c03b-4a01-a1a6-d009738260c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:51.273890 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:51.274752 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.279996 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b930397-969c-44e0-a47d-103b267b2f8a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:51.294827 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:51.304198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.305655 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:51.306570 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.313406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:51.472317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Pushing event updated for resources: {'Network': ['ID=eea6c2fb-29bc-4ead-92f8-0304ed714d21,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:51.477701 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:51.492416 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 15:02:51.508370 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-3ffa4895-ad2b-4777-974e-92b4202ccbbc admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 0.8552475
May 26 15:02:51.508370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33564) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:51.516050 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Request body: {'subnet': {'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1829784076-subnet', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:51.532784 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.536370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:51.547852 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Transition to ACTIVE for port object e1b444e0-d083-4f15-a3d0-2a82bf7344cc will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:51.553413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Usage tracker for resource:subnet and tenant:298f387c22874d8cbf8b86ab642c6bc1 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:51.558067 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:51.566280 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:51.594555 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.600536 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-4b66a72b-beba-4d24-a1b4-aaae93221c21 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:51.611662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Made reservation on behalf of 298f387c22874d8cbf8b86ab642c6bc1 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:51.614397 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.661066 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a13b66-7a54-422d-afe8-55518c416019 req-6ec08ecb-4a28-4459-ba5b-d377e983d06b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:51.662484 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-66a13b66-7a54-422d-afe8-55518c416019 req-6ec08ecb-4a28-4459-ba5b-d377e983d06b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1098 time: 0.2912545
May 26 15:02:51.728682 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-66a13b66-7a54-422d-afe8-55518c416019 req-fbb748ab-0d3b-47d0-9e31-b1529791d7b7 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0592039
May 26 15:02:51.761040 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Pushing event updated for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.808940 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.809789 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.809789 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.809944 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:02:51.837879 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:51.867830 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Attempting to bind port e1b444e0-d083-4f15-a3d0-2a82bf7344cc on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:51.868196 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Attempting to bind port e1b444e0-d083-4f15-a3d0-2a82bf7344cc by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:51.868555 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Attempting to bind port e1b444e0-d083-4f15-a3d0-2a82bf7344cc on network 91d594ee-93aa-497d-af26-3f3353865830 {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:51.875317 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:51.876053 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Checking segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:51.876676 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.877292 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Bound using segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:51.877995 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Bound port: e1b444e0-d083-4f15-a3d0-2a82bf7344cc, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:51.878676 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:51.981803 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] For port e1b444e0-d083-4f15-a3d0-2a82bf7344cc, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:51.985252 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] For port e1b444e0-d083-4f15-a3d0-2a82bf7344cc, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:52.029387 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.034961 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:52.106281 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:52.107043 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4ce2190>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:52.204586 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Pushing event updated for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:52.208755 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-c5f880c5-4726-4d08-8878-625e633652a7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:52.294145 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.303028 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:52.333461 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:52.345773 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9f7d629a-4776-4ea2-afba-6eb813f5d6ff req-8dc22024-f8b2-4747-b8bf-6d5fadaddee4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0637605
May 26 15:02:52.384780 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4283290b-0d37-48e7-af9c-f99554271f55,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:52.397826 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e req-0e258bf1-c437-460d-8654-6e62c2ff4dd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:52.397826 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e req-0e258bf1-c437-460d-8654-6e62c2ff4dd1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.2204840
May 26 15:02:52.398022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:52.404260 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Checking segment: {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:52.405179 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Network hostable DHCP agents. Network: eea6c2fb-29bc-4ead-92f8-0304ed714d21, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 15:02:52.469334 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e req-78d8c763-3728-46ed-8c40-fd472f9092f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0597496
May 26 15:02:52.548226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 15:02:52.657275 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, eea6c2fb-29bc-4ead-92f8-0304ed714d21) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:52.665927 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8b10d96-ec25-411d-a78c-3618aea68a94 None None] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:02:52.674943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:52.675530 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.696688 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4ce2190>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:51Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:52.701104 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bcdef71-28a4-4749-beb9-81aff9a1fd91 None None] The sync data for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi is: [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:51Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:52.756095 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.2480638
May 26 15:02:52.758532 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33580) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:52.770196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:52.775630 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:52.781278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Usage tracker for resource:router and tenant:298f387c22874d8cbf8b86ab642c6bc1 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:02:52.786163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:02:52.792355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:52.903332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.904525 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.924216 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:52.983578 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'fixed_ips': [{'subnet_id': '4283290b-0d37-48e7-af9c-f99554271f55'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 15:02:52.984234 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.169936 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e1b444e0-d083-4f15-a3d0-2a82bf7344cc up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:53.255593 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-af7cab00-6f9c-413b-bb14-2c5e98858444 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.258440 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.312438 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Allocated IP 172.20.0.2 (eea6c2fb-29bc-4ead-92f8-0304ed714d21/4283290b-0d37-48e7-af9c-f99554271f55/1daaadc3-28e1-4ca5-9439-225498a1194f) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:53.445669 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.451499 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:53.464086 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:53.464596 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.615162 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-490d665b-341a-410d-b51d-347827d6a78e req-c1e30a0f-c219-45e0-b502-6cdc7c875a7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0889618
May 26 15:02:53.702611 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.717513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Transition to ACTIVE for port object 1daaadc3-28e1-4ca5-9439-225498a1194f will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:53.739600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Transition to ACTIVE for port object 1daaadc3-28e1-4ca5-9439-225498a1194f will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:53.760845 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7eb7095-0265-409e-ad76-9bd72acddf54 req-079a30b2-af06-4dfb-8de1-c454cc8d4ac3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:53.770662 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c7eb7095-0265-409e-ad76-9bd72acddf54 req-079a30b2-af06-4dfb-8de1-c454cc8d4ac3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1339157
May 26 15:02:53.823689 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.849010 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-bcd9ba3d-f8b0-401d-b70c-42b67ffbe0aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:53.850777 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-bcd9ba3d-f8b0-401d-b70c-42b67ffbe0aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 810 time: 0.2340190
May 26 15:02:53.864616 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:53.875325 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:53.929784 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-9a34c8d2-4705-404d-a3ae-0e2f0a3b32ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc HTTP/1.1" status: 200  len: 380 time: 0.0691833
May 26 15:02:53.947367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port e1b444e0-d083-4f15-a3d0-2a82bf7344cc, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:53.948558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'port': {'device_id': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'admin_state_up': True, 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'security_groups': ['9f4f2011-11f2-4842-b93a-4f7e6c181dfc']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:53.954802 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:53.958217 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:53.962204 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:53.968876 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Pushing event updated for resources: {'Port': ['ID=1daaadc3-28e1-4ca5-9439-225498a1194f,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:53.980319 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:53.995169 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c7eb7095-0265-409e-ad76-9bd72acddf54 req-bf27da25-ada3-45e4-b848-131fcb4ab9a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2235560
May 26 15:02:54.043836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.079278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.101184 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.137046 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:54.240522 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Attempting to bind port 1daaadc3-28e1-4ca5-9439-225498a1194f on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:54.240962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Attempting to bind port 1daaadc3-28e1-4ca5-9439-225498a1194f by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:54.241816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Attempting to bind port 1daaadc3-28e1-4ca5-9439-225498a1194f on network eea6c2fb-29bc-4ead-92f8-0304ed714d21 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:54.254116 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:54.255168 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Checking segment: {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:54.255168 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.255628 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Bound using segment: {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:54.256586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Bound port: 1daaadc3-28e1-4ca5-9439-225498a1194f, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:54.256586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.269162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Allocated IP 172.27.2.190 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/e5bc55b5-4029-49ed-a534-f75fa46e3c66) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:54.312148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.321060 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:54.330708 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:54.366775 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] For port 1daaadc3-28e1-4ca5-9439-225498a1194f, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:54.367606 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:02:54.369788 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] For port 1daaadc3-28e1-4ca5-9439-225498a1194f, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1daaadc3-28e1-4ca5-9439-225498a1194f,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:54.385969 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:02:54.419280 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41fbef1-7cc2-4087-b452-511a66cd28c7 req-3b44a86d-4be6-4a80-9880-d4b37ac5c195 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:54.421469 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b41fbef1-7cc2-4087-b452-511a66cd28c7 req-3b44a86d-4be6-4a80-9880-d4b37ac5c195 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1734409
May 26 15:02:54.431307 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 33602) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:54.438410 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Request body: {'floatingip': {'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:54.440689 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.459145 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.463068 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:54.524931 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Made reservation on behalf of 81e8cac36a174b2eb5a6e53fdf25b4cc for: {'port': 1} {{(pid=103981) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:02:54.528645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.547733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.555306 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Pushing event updated for resources: {'Port': ['ID=1daaadc3-28e1-4ca5-9439-225498a1194f,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:54.561823 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:54.564524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a0805ccc-1842-4084-bf42-c1daa5e12074 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:54.568359 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:54.634318 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:54.637413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:54.642044 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:54.691143 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Pushing event updated for resources: {'Port': ['ID=e5bc55b5-4029-49ed-a534-f75fa46e3c66,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:54.697950 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:54.952317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-b1967336-296f-428f-bb0d-a381507d012a req-12ad48d0-ed4e-4fc7-a7fe-562fd63e9197 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:55.012919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-b1967336-296f-428f-bb0d-a381507d012a req-12ad48d0-ed4e-4fc7-a7fe-562fd63e9197 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:55.014148 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1967336-296f-428f-bb0d-a381507d012a req-12ad48d0-ed4e-4fc7-a7fe-562fd63e9197 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.2315588
May 26 15:02:55.199046 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e1b444e0-d083-4f15-a3d0-2a82bf7344cc up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:55.267425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port e1b444e0-d083-4f15-a3d0-2a82bf7344cc triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:55.267651 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.288421 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:02:55.293237 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Allocated IP 172.20.0.12 (9a6b2b45-d448-425b-9716-75ffabad6539/455a1c06-d094-4995-9b7a-561be9ec484c/5bd02faf-9eb5-4f97-86fd-6985a1bd6902) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:55.495238 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1daaadc3-28e1-4ca5-9439-225498a1194f up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:55.513574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.679775 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.749222 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.760843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.761870 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 1daaadc3-28e1-4ca5-9439-225498a1194f completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:55.766027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.827351 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d81afcf-976c-4cc2-b0c1-a26efc7591f1 None None] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:02:55.827762 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Transition to ACTIVE for port object 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 will not be triggered until provisioned by entity DHCP. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:55.944752 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:55.959852 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Floating IP 4614d2d8-5366-420f-9544-f7eeb2cf1a62 associated. External IP: 172.27.2.125, port: d9f82690-b757-4c6f-b288-d20d193f4031.
May 26 15:02:56.074580 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Provisioning for port 1daaadc3-28e1-4ca5-9439-225498a1194f completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:56.083280 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Provisioning complete for port 1daaadc3-28e1-4ca5-9439-225498a1194f triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:56.083663 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.224216 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.234475 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.266442 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] For port 1daaadc3-28e1-4ca5-9439-225498a1194f, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1daaadc3-28e1-4ca5-9439-225498a1194f,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:02:56.278603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:56.281503 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Router 77beb3ec-f440-47ad-81e0-105d4f2f195c is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 15:02:56.337306 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.339568 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:56.367480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Network 9a6b2b45-d448-425b-9716-75ffabad6539 is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:56.382895 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:56.392528 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:56.447480 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Pushing event updated for resources: {'Port': ['ID=1daaadc3-28e1-4ca5-9439-225498a1194f,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:56.463493 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:56.484312 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7463349b-dfe9-4caa-a8f0-4cf865682af7 None None] Provisioning complete for port 1daaadc3-28e1-4ca5-9439-225498a1194f triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:56.484953 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7463349b-dfe9-4caa-a8f0-4cf865682af7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.531942 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event updated for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:56.542381 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.264s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:56.555908 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:56.574866 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Sync routers for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:56.591568 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:56.594762 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41cbcd0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:56.600035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:56.600689 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.628722 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:56.630245 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 927 time: 3.8706033
May 26 15:02:56.632837 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33668) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:02:56.738930 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 req-d6288db4-8ae8-4824-b7b7-cc9355c18eac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:56.739773 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 req-d6288db4-8ae8-4824-b7b7-cc9355c18eac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:02:56.776371 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.8375795
May 26 15:02:56.846889 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:56.862861 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Request body: {'port': {'device_id': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:02:56.898866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 req-d6288db4-8ae8-4824-b7b7-cc9355c18eac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:02:56.900379 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 req-d6288db4-8ae8-4824-b7b7-cc9355c18eac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 932 time: 0.6813891
May 26 15:02:57.044342 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 req-ba4e4f6a-fc6e-4a54-aaa0-6995679b1b2c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1288118
May 26 15:02:57.044865 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.057788 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:02:57.087781 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-ccaa9d39-3f3b-46de-90e9-1b626622128d None None] Provisioning for port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:57.094046 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-ccaa9d39-3f3b-46de-90e9-1b626622128d None None] Provisioning complete for port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:57.094405 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-ccaa9d39-3f3b-46de-90e9-1b626622128d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.185509 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1daaadc3-28e1-4ca5-9439-225498a1194f up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:02:57.245524 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-ccaa9d39-3f3b-46de-90e9-1b626622128d None None] Port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:02:57.302903 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 1daaadc3-28e1-4ca5-9439-225498a1194f triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:57.303431 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.335794 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41cbcd0>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 3, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:02:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:57.356298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Checking router: 77beb3ec-f440-47ad-81e0-105d4f2f195c for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:57.356716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Updating router 77beb3ec-f440-47ad-81e0-105d4f2f195c port e5bc55b5-4029-49ed-a534-f75fa46e3c66 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:02:57.391033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:02:57.407895 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:02:57.427330 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:57.430212 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5971d30>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:57.444280 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.452265 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.540157 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-16cc7c6d-d327-4435-9ea9-ea51386229c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "PUT /v2.0/floatingips/4614d2d8-5366-420f-9544-f7eeb2cf1a62 HTTP/1.1" status: 200  len: 991 time: 3.1076887
May 26 15:02:57.543924 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:02:57.681428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.710713 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 {{(pid=103981) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:02:57.737937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.768215 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:57.785128 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.provisioning_blocks [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Transition to ACTIVE for port object 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 will not be triggered until provisioned by entity L2. {{(pid=103981) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:57.864467 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:57.870827 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d5b36dc-c24d-4311-b209-2acc88637b90 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:58.133470 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.147544 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Transition to ACTIVE for port object e5bc55b5-4029-49ed-a534-f75fa46e3c66 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:58.206709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.211665 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:58.238966 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'status': 'completed', 'code': 200}
May 26 15:02:58.321408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Allocated IP 172.20.0.1 (eea6c2fb-29bc-4ead-92f8-0304ed714d21/4283290b-0d37-48e7-af9c-f99554271f55/5d5560a2-c522-4536-9b60-b40d733fe8dd) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:02:58.327957 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-03301db0-e49a-4df9-82aa-b0727be37dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.330018 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-03301db0-e49a-4df9-82aa-b0727be37dbd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1098 time: 0.3316705
May 26 15:02:58.343793 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5971d30>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '4614d2d8-5366-420f-9544-f7eeb2cf1a62', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '757c7def-93df-481f-b40d-7115f4bbbefe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:33Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:58.348279 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:02:58.348466 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Attempting to bind port e5bc55b5-4029-49ed-a534-f75fa46e3c66 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:58.348922 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Attempting to bind port e5bc55b5-4029-49ed-a534-f75fa46e3c66 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:58.349334 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Attempting to bind port e5bc55b5-4029-49ed-a534-f75fa46e3c66 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:58.353857 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Pushing event updated for resources: {'Port': ['ID=e5bc55b5-4029-49ed-a534-f75fa46e3c66,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:58.360082 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:58.362878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:58.362878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:58.362878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.362878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:58.362878 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Bound port: e5bc55b5-4029-49ed-a534-f75fa46e3c66, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:58.363402 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.372600 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:58.373385 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5971d30>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:58.434670 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Pushing event updated for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:58.449061 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.578s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:58.459322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] For port e5bc55b5-4029-49ed-a534-f75fa46e3c66, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:58.465172 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] For port e5bc55b5-4029-49ed-a534-f75fa46e3c66, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e5bc55b5-4029-49ed-a534-f75fa46e3c66,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:58.500642 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08f8f178-62d6-4276-863f-f1d935a16cef req-ffe073c5-36af-41c3-9d75-433c922262b0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.507904 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-08f8f178-62d6-4276-863f-f1d935a16cef req-ffe073c5-36af-41c3-9d75-433c922262b0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 944 time: 0.2429121
May 26 15:02:58.510744 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Attempting to bind port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:02:58.511622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Attempting to bind port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:02:58.511622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Attempting to bind port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:58.535511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 on network 9a6b2b45-d448-425b-9716-75ffabad6539 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:02:58.535511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Attempting to bind port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 on network 9a6b2b45-d448-425b-9716-75ffabad6539 {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:02:58.542274 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:02:58.542610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Checking segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103981) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:02:58.543464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Bound using segment: {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'} {{(pid=103981) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:02:58.543464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.managers [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Bound port: 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1230, 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539'}}] {{(pid=103981) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:02:58.543749 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.549037 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.552849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:58.589321 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-8023e9b4-ccd8-4d0e-96ae-2004c3d43bcb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.596055 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-8023e9b4-ccd8-4d0e-96ae-2004c3d43bcb service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.2537169
May 26 15:02:58.618048 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-08f8f178-62d6-4276-863f-f1d935a16cef req-dd1065e1-e680-496b-b9aa-6ca1c2a5eb85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1091182
May 26 15:02:58.640457 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:58.643649 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:02:58.646249 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac41cbcd0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:58.684901 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, cleared binding levels {{(pid=103981) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:02:58.689591 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103981) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:02:58.702709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Pushing event updated for resources: {'Port': ['ID=e5bc55b5-4029-49ed-a534-f75fa46e3c66,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:58.713748 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.161s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:58.753463 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-bfa16f18-9b5e-44f5-9a21-bdfc2d007669 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 999 time: 0.1540377
May 26 15:02:58.760235 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.764644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:58.812855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.837379 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.838266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:58.839930 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] 10.222.0.32 "PUT /v2.0/ports/5bd02faf-9eb5-4f97-86fd-6985a1bd6902 HTTP/1.1" status: 200  len: 1094 time: 1.9821126
May 26 15:02:58.843832 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:02:58.846698 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Transition to ACTIVE for port object 5d5560a2-c522-4536-9b60-b40d733fe8dd will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:02:58.858336 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ee9876ae-7a0b-4f28-a69d-64019ea9f804 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.860222 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ee9876ae-7a0b-4f28-a69d-64019ea9f804 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0954401
May 26 15:02:58.865162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Pushing event updated for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=3']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:58.876752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:58.992285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-5370ecb2-8492-4bde-ba23-1e009eaa691b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:58.994601 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-5370ecb2-8492-4bde-ba23-1e009eaa691b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1136103
May 26 15:02:59.063662 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:59.087637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-efcefaeb-0975-41ed-88f5-a13eaa29b6f1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:02:59.115358 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d0f64771-e3e9-42d6-b986-8a236836d7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:59.116912 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-d0f64771-e3e9-42d6-b986-8a236836d7a7 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 1097 time: 0.1710744
May 26 15:02:59.188419 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5971d30>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '4614d2d8-5366-420f-9544-f7eeb2cf1a62', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '757c7def-93df-481f-b40d-7115f4bbbefe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:33Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:59.194998 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1677b070-8098-4a2e-9ea2-18c656b953cf None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '4614d2d8-5366-420f-9544-f7eeb2cf1a62', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '757c7def-93df-481f-b40d-7115f4bbbefe', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:33Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 1, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:59.205952 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-3fb01abb-2573-4982-8839-b5a7d1375783 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902 HTTP/1.1" status: 200  len: 217 time: 0.0806127
May 26 15:02:59.248740 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:02:59.272483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:02:59.278933 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:02:59.308621 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac41cbcd0>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 3, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:02:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:02:59.315619 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-730d6a6e-02f7-4a7a-b170-652b2f1d1847 None None] The sync data for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi is: [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:55Z', 'revision_number': 3, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:02:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:02:59.324746 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-f37b7db4-553f-4354-a388-c480505d960c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:59.326339 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-f37b7db4-553f-4354-a388-c480505d960c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.1131268
May 26 15:02:59.386623 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Pushing event updated for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:02:59.411386 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:59.441347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-09760b37-6e81-44ce-ae84-011d137c5dcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:02:59.443926 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-09760b37-6e81-44ce-ae84-011d137c5dcd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1103079
May 26 15:02:59.450301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.363s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:02:59.458484 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:59.532209 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-d3e58280-308b-4ac5-b903-c2714d57bcb4 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5305016
May 26 15:02:59.556903 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd150694-a6ff-4858-b77f-7a903c3492ac None None] New status for floating IP 4614d2d8-5366-420f-9544-f7eeb2cf1a62: ACTIVE {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:02:59.628230 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-3b5913dc-7210-44f6-9a20-2fa6a14083da service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1598172
May 26 15:02:59.820082 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-1c77cfa3-6a1f-4f31-825e-12e455924eaf None None] Provisioning for port 5d5560a2-c522-4536-9b60-b40d733fe8dd completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:02:59.831427 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-1b02f3f7-b4a1-4864-9184-f6514a47dff6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.4458885
May 26 15:02:59.893777 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-1c77cfa3-6a1f-4f31-825e-12e455924eaf None None] Provisioning complete for port 5d5560a2-c522-4536-9b60-b40d733fe8dd triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:02:59.895634 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1c77cfa3-6a1f-4f31-825e-12e455924eaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:02:59.906949 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-9d9e1b83-9131-4640-8901-4ad1c6fea2e1 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3659909
May 26 15:03:00.000655 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-496aabeb-881e-4afb-83e2-f597af2afcf9 req-2fc921ef-754d-47fe-aee8-62e89d459ee6 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3630366
May 26 15:03:00.018390 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-eae39c7d-a6dd-4479-8d42-9086e9cb6363 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.019978 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-eae39c7d-a6dd-4479-8d42-9086e9cb6363 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0927522
May 26 15:03:00.024599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b10373e-0202-4adc-b3ef-221c0561da06 req-14b4388d-8983-43a8-90b8-06ec277c45d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.026440 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b10373e-0202-4adc-b3ef-221c0561da06 req-14b4388d-8983-43a8-90b8-06ec277c45d4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 944 time: 0.2060676
May 26 15:03:00.072645 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-1c77cfa3-6a1f-4f31-825e-12e455924eaf None None] Port 5d5560a2-c522-4536-9b60-b40d733fe8dd cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:03:00.097470 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4b10373e-0202-4adc-b3ef-221c0561da06 req-9a5bb592-700b-4216-be30-85fe40de483d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0579281
May 26 15:03:00.179812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:00.241367 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:00.290574 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'status': 'completed', 'code': 200}
May 26 15:03:00.312628 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-e508c1a4-f8fc-4b2a-8f54-720ab9e2750d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.320144 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-e508c1a4-f8fc-4b2a-8f54-720ab9e2750d service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.2562742
May 26 15:03:00.419863 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-b50d0e5a-d7d0-43c1-9348-75faeabb62d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.422904 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-b50d0e5a-d7d0-43c1-9348-75faeabb62d1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 1097 time: 0.1001360
May 26 15:03:00.525212 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-df6653c3-39a6-4a14-88a6-5aa39122ea5b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 1000 time: 0.1940601
May 26 15:03:00.577611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-b564a09a-6b37-4f35-b49a-f62f94df1ad0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.579063 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-b564a09a-6b37-4f35-b49a-f62f94df1ad0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.1480727
May 26 15:03:00.619006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-c354e9b8-4931-4fdc-9edb-796edeab61d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.620580 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-c354e9b8-4931-4fdc-9edb-796edeab61d6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0778615
May 26 15:03:00.653066 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-d8497941-0879-4d65-abab-e4c9608c47a6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902 HTTP/1.1" status: 200  len: 217 time: 0.0661278
May 26 15:03:00.671746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:00.709844 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-b4d5133d-1ef0-4b40-ab63-360c1884c154 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.711369 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-b4d5133d-1ef0-4b40-ab63-360c1884c154 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0803118
May 26 15:03:00.714097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:00.718180 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-a743eb9a-35b3-4cfb-a92b-e7eed78e0604 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.719635 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-a743eb9a-35b3-4cfb-a92b-e7eed78e0604 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.0596311
May 26 15:03:00.743841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e0e7b6b2-9371-42c9-8548-0259222fd7d1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:00.808401 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-c0c80aad-3dea-4cfd-8184-bb7ef4d7c9b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:00.809902 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-c0c80aad-3dea-4cfd-8184-bb7ef4d7c9b4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0823758
May 26 15:03:00.918296 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Pushing event updated for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:00.931850 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:00.931850 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:00.957095 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-b57db3cf-202b-401f-85bb-c94ce4a9aa7d service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1402388
May 26 15:03:01.063523 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-44e3ec0a-f8a3-4f1f-a865-688b19f7fb33 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3232741
May 26 15:03:01.163738 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e5bc55b5-4029-49ed-a534-f75fa46e3c66 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:01.245040 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:03:01.248989 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:03:01.306639 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-d3b385b2-dd73-4ca7-9a69-f298c84d4b9e service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3343382
May 26 15:03:01.314549 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port e5bc55b5-4029-49ed-a534-f75fa46e3c66 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:03:01.324215 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port e5bc55b5-4029-49ed-a534-f75fa46e3c66 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:01.324917 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:01.409829 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-5f742411-3ecd-492b-a15f-c8a1d7d44a1e service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3372781
May 26 15:03:01.548680 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:01.566550 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port e5bc55b5-4029-49ed-a534-f75fa46e3c66, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e5bc55b5-4029-49ed-a534-f75fa46e3c66,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:01.602573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-bdd167c4-b7f6-4f14-92bc-52227f95a98c None None] Provisioning complete for port 5d5560a2-c522-4536-9b60-b40d733fe8dd triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:01.602951 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bdd167c4-b7f6-4f14-92bc-52227f95a98c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:01.646604 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:01.650973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:01.675636 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859811e7-16d5-4f03-894e-d2d76c3b56de req-359bfad8-bee8-4941-a312-0135f1a8431d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:01.679839 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-859811e7-16d5-4f03-894e-d2d76c3b56de req-359bfad8-bee8-4941-a312-0135f1a8431d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 944 time: 0.4218583
May 26 15:03:01.704338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Router 77beb3ec-f440-47ad-81e0-105d4f2f195c has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:03:01.713035 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-bdd167c4-b7f6-4f14-92bc-52227f95a98c None None] Port 5d5560a2-c522-4536-9b60-b40d733fe8dd cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:03:01.728153 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=e5bc55b5-4029-49ed-a534-f75fa46e3c66,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:01.731111 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:01.786487 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-859811e7-16d5-4f03-894e-d2d76c3b56de req-2ba3543f-7b57-487b-8eed-d39614077b9a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1014318
May 26 15:03:01.918259 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:03:01.926667 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Sync routers for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:03:01.932457 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] 10.222.0.81 "PUT /v2.0/routers/77beb3ec-f440-47ad-81e0-105d4f2f195c/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.2931666
May 26 15:03:01.937113 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:01.937718 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4c3e700>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:02.121901 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:02.494818 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4c3e700>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:59Z', 'revision_number': 4, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '5d5560a2-c522-4536-9b60-b40d733fe8dd', 'name': '', 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'mac_address': 'fa:16:3e:10:d8:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '4283290b-0d37-48e7-af9c-f99554271f55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:57Z', 'updated_at': '2021-05-26T15:03:00Z', 'revision_number': 2, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'subnets': [{'id': '4283290b-0d37-48e7-af9c-f99554271f55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:02.499841 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Checking router: 77beb3ec-f440-47ad-81e0-105d4f2f195c for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:03:02.500190 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Updating router 77beb3ec-f440-47ad-81e0-105d4f2f195c port 5d5560a2-c522-4536-9b60-b40d733fe8dd binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:03:02.538352 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:03:02.556615 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:02.702766 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:02.719047 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'port_id': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'mac_address': 'fa:16:3e:c1:23:7d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1230, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:03:02.777575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:02.797817 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:03:02.815851 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:02.897473 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:02.899675 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:02.953742 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:02.965935 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Transition to ACTIVE for port object 5d5560a2-c522-4536-9b60-b40d733fe8dd will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:03:03.016095 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:03.018223 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:03.039124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0374ad7d-b896-42c4-bfde-fb61668dda28 req-8521158a-f5d8-4682-86e0-3716d57b7eab tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:03.040713 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0374ad7d-b896-42c4-bfde-fb61668dda28 req-8521158a-f5d8-4682-86e0-3716d57b7eab tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 945 time: 0.1384382
May 26 15:03:03.047228 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:03.066084 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:03.108129 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0374ad7d-b896-42c4-bfde-fb61668dda28 req-e99abe00-56f7-48c3-9df6-a25a7db43e84 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0597818
May 26 15:03:03.148111 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['5bd02faf-9eb5-4f97-86fd-6985a1bd6902'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:03:03.237384 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e5bc55b5-4029-49ed-a534-f75fa46e3c66 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:03.305489 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144f3506-a9f0-44ae-8358-c380a1ad68f5 None None] Pushing event updated for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:03.319764 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-144f3506-a9f0-44ae-8358-c380a1ad68f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:03.343860 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Attempting to bind port 5d5560a2-c522-4536-9b60-b40d733fe8dd on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:03:03.344232 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Attempting to bind port 5d5560a2-c522-4536-9b60-b40d733fe8dd by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:03:03.344594 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Attempting to bind port 5d5560a2-c522-4536-9b60-b40d733fe8dd on network eea6c2fb-29bc-4ead-92f8-0304ed714d21 {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:03:03.350597 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 2, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:03:03.350972 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Checking segment: {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:03:03.351371 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:03.351766 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Bound using segment: {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:03:03.352244 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Bound port: 5d5560a2-c522-4536-9b60-b40d733fe8dd, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1203, 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:03:03.352613 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:03.370514 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port e5bc55b5-4029-49ed-a534-f75fa46e3c66 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:03.370892 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:03.482546 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] For port 5d5560a2-c522-4536-9b60-b40d733fe8dd, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:03:03.487161 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] For port 5d5560a2-c522-4536-9b60-b40d733fe8dd, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=5d5560a2-c522-4536-9b60-b40d733fe8dd,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:03:03.558017 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:03.564458 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-5dbdf903-32da-41a5-b6dc-0e05489a5055 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:03.664225 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:03.664871 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4c3e700>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:03.740365 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144f3506-a9f0-44ae-8358-c380a1ad68f5 None None] Pushing event updated for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:03.752321 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-144f3506-a9f0-44ae-8358-c380a1ad68f5 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:03.904286 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:04.331417 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4c3e700>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:59Z', 'revision_number': 4, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '5d5560a2-c522-4536-9b60-b40d733fe8dd', 'name': '', 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'mac_address': 'fa:16:3e:10:d8:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '4283290b-0d37-48e7-af9c-f99554271f55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:57Z', 'updated_at': '2021-05-26T15:03:03Z', 'revision_number': 4, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'subnets': [{'id': '4283290b-0d37-48e7-af9c-f99554271f55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:04.337558 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e488127-90b8-47ff-a493-c66bdcc39821 None None] The sync data for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi is: [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:02:59Z', 'revision_number': 4, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '5d5560a2-c522-4536-9b60-b40d733fe8dd', 'name': '', 'network_id': 'eea6c2fb-29bc-4ead-92f8-0304ed714d21', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'mac_address': 'fa:16:3e:10:d8:fd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_interface', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': '4283290b-0d37-48e7-af9c-f99554271f55', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:57Z', 'updated_at': '2021-05-26T15:03:03Z', 'revision_number': 4, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'subnets': [{'id': '4283290b-0d37-48e7-af9c-f99554271f55', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:03:04.354470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a53922f1-0aca-43c1-9780-08aadd891bf6 req-f7f84225-a9b0-4256-9382-81ab25bb8846 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:04.363281 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a53922f1-0aca-43c1-9780-08aadd891bf6 req-f7f84225-a9b0-4256-9382-81ab25bb8846 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 945 time: 0.1135511
May 26 15:03:04.429890 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a53922f1-0aca-43c1-9780-08aadd891bf6 req-023874bd-230d-445a-ba67-15a0b16fd4a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0635705
May 26 15:03:04.565961 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:04.771345 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:03:04.780957 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:04.781355 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:04.938513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:04.994148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:05.013435 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:05.067734 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'code': 200}
May 26 15:03:05.103337 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:05.103337 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-278c025d-3d84-4af9-8377-676682d1c598 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:05.202129 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 5d5560a2-c522-4536-9b60-b40d733fe8dd up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:05.312265 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:05.316486 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:05.377376 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 5d5560a2-c522-4536-9b60-b40d733fe8dd completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:03:05.387013 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 5d5560a2-c522-4536-9b60-b40d733fe8dd triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:05.387376 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:05.570928 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:05.626908 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 5d5560a2-c522-4536-9b60-b40d733fe8dd, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=5d5560a2-c522-4536-9b60-b40d733fe8dd,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:05.696126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:05.703691 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:05.704845 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdea24f-1755-4de1-8556-67db40e01b1c req-d150043f-3a28-49fa-9329-61c7b5bfddda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:05.707356 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5fdea24f-1755-4de1-8556-67db40e01b1c req-d150043f-3a28-49fa-9329-61c7b5bfddda service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 1099 time: 0.2285614
May 26 15:03:05.763638 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5fdea24f-1755-4de1-8556-67db40e01b1c req-dfcdf57e-2048-4518-be80-b11d4c8aabfc service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0477335
May 26 15:03:05.775586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a996b0a-e746-40ef-80ea-779b922e84d0 req-75477fe0-ee11-487c-8229-1ee14575f3fb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:05.777203 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5a996b0a-e746-40ef-80ea-779b922e84d0 req-75477fe0-ee11-487c-8229-1ee14575f3fb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.1759818
May 26 15:03:05.860005 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:05.863289 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:05.870151 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5a996b0a-e746-40ef-80ea-779b922e84d0 req-6db9ea33-a0b6-4791-be5c-32b152a51724 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0720382
May 26 15:03:07.100784 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e4af03a-998f-4e44-a265-9604261f1df5 req-20a0a8eb-2cd0-43cc-a0ac-fa8ab82520d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:07.102427 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3e4af03a-998f-4e44-a265-9604261f1df5 req-20a0a8eb-2cd0-43cc-a0ac-fa8ab82520d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.1021235
May 26 15:03:07.144866 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 5d5560a2-c522-4536-9b60-b40d733fe8dd up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:07.157184 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3e4af03a-998f-4e44-a265-9604261f1df5 req-5d24724b-d81f-430f-861e-5e5e67f88ffa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0486150
May 26 15:03:07.251686 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 5d5560a2-c522-4536-9b60-b40d733fe8dd triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:07.251686 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:07.363071 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2160705b-01a9-455d-a135-ad31d2d35cca req-6b286ba7-8d06-47bf-8d77-3103e71af8aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:07.374745 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33770) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:07.375389 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2160705b-01a9-455d-a135-ad31d2d35cca req-6b286ba7-8d06-47bf-8d77-3103e71af8aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.0883131
May 26 15:03:07.380122 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Request body: {'floatingip': {'port_id': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:07.496596 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:08.453951 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:08.521478 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:08.711503 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Floating IP 5cbf2dfd-9afc-42d6-a2b6-9868818661fb associated. External IP: 172.27.2.230, port: 5bd02faf-9eb5-4f97-86fd-6985a1bd6902.
May 26 15:03:09.079809 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:03:09.271627 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:03:09.285535 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:09.291319 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:03:09.305695 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:09.305695 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac477d2b0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:09.362262 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7c998e3d-aa78-4982-a1ce-016d55b28091 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "PUT /v2.0/floatingips/5cbf2dfd-9afc-42d6-a2b6-9868818661fb HTTP/1.1" status: 200  len: 992 time: 1.9862587
May 26 15:03:09.363172 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:09.424572 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'status': 'completed', 'code': 200}
May 26 15:03:09.535328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-f6a463b9-e98a-49e2-8884-a654731b25ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:09.537560 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-f6a463b9-e98a-49e2-8884-a654731b25ac service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 1099 time: 0.0809367
May 26 15:03:09.652588 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:09.689941 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-cf7bed7a-34db-4d8c-8c44-00700218c70a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:09.691369 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-cf7bed7a-34db-4d8c-8c44-00700218c70a service neutron] 10.222.0.32 "GET /v2.0/networks?id=9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 200  len: 912 time: 0.1471202
May 26 15:03:09.911011 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-5775685c-564e-40eb-ba3a-14f23283a15f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902 HTTP/1.1" status: 200  len: 1000 time: 0.2122290
May 26 15:03:09.973198 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac477d2b0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '5cbf2dfd-9afc-42d6-a2b6-9868818661fb', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.230', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:c1:23:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:48Z', 'updated_at': '2021-05-26T15:03:08Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:09.977133 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:03:09.986674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:09.987386 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac477d2b0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:02:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:09.999547 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-4ec308cb-613f-4c38-b9a7-f9b87f19c30d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:10.001592 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-4ec308cb-613f-4c38-b9a7-f9b87f19c30d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 200  len: 849 time: 0.0830388
May 26 15:03:10.100887 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-049f37cf-2550-4da8-b7ac-53707c04cc44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:10.102930 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-049f37cf-2550-4da8-b7ac-53707c04cc44 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=9a6b2b45-d448-425b-9716-75ffabad6539&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0931337
May 26 15:03:10.190642 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:10.261042 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-5a87726b-5d2b-42e5-b56e-2a579b80db8b service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1505673
May 26 15:03:10.437284 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-d30cc9a5-f3cf-43a3-a553-ab9017e30b74 service neutron] 10.222.0.32 "GET /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1667297
May 26 15:03:10.613282 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac477d2b0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '5cbf2dfd-9afc-42d6-a2b6-9868818661fb', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.230', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:c1:23:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:48Z', 'updated_at': '2021-05-26T15:03:08Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:10.617496 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9a320702-06b7-4882-8865-cc2226fdaed7 None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '5cbf2dfd-9afc-42d6-a2b6-9868818661fb', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'floating_ip_address': '172.27.2.230', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'port_id': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 520, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'mac_address': 'fa:16:3e:c1:23:7d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:02:48Z', 'updated_at': '2021-05-26T15:03:08Z', 'revision_number': 1, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:03:10.860867 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3481c53-640d-47a5-9745-c296ba2fc0d1 None None] New status for floating IP 5cbf2dfd-9afc-42d6-a2b6-9868818661fb: ACTIVE {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:03:14.320829 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-d7fa76b0-d597-429e-b19d-5b20deab1e96 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:14.322278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-d7fa76b0-d597-429e-b19d-5b20deab1e96 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 814 time: 0.1509373
May 26 15:03:14.337934 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-2a55410d-736b-458d-ba39-eed93d9bfea6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/quotas/83937b4f3831489289cd8aec97222f77 HTTP/1.1" status: 200  len: 375 time: 0.0094829
May 26 15:03:14.425211 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-823a89a0-1a46-4ffc-b1e9-2381c675dee5 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0818090
May 26 15:03:14.614925 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-c2b2e8aa-94cd-4d7d-83b4-e98b3b306260 service neutron] 10.222.0.81 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1775496
May 26 15:03:14.746412 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-c201d430-9e0b-4ef9-af01-e59eef8620f4 service neutron] 10.222.0.81 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1255381
May 26 15:03:15.005067 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-348c903c-e639-43c4-93c8-46dc611f14e8 req-5b375cd8-fa93-4355-beb8-76cd39ff6fb6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:03:15.096994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-348c903c-e639-43c4-93c8-46dc611f14e8 req-5b375cd8-fa93-4355-beb8-76cd39ff6fb6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:03:15.098208 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-348c903c-e639-43c4-93c8-46dc611f14e8 req-5b375cd8-fa93-4355-beb8-76cd39ff6fb6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 210 time: 0.1368852
May 26 15:03:16.259843 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 req-beac2a1a-8a40-45b2-8bc5-c5f8883aa1b3 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 210 time: 0.0497484
May 26 15:03:17.292632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-49f76d70-27c3-4467-a58d-c1984ac442a7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:17.294233 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-49f76d70-27c3-4467-a58d-c1984ac442a7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 814 time: 0.1585197
May 26 15:03:17.307502 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'port': {'device_id': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'admin_state_up': True, 'tenant_id': '83937b4f3831489289cd8aec97222f77'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:17.422249 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07374088-3c8a-4788-855a-b1a4cb220f88 req-a4cfafe5-ad0a-4986-9ab0-db5508754b10 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 210 time: 0.0477867
May 26 15:03:17.457438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:17.467652 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:17.543334 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Made reservation on behalf of 83937b4f3831489289cd8aec97222f77 for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:03:17.547070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:17.718934 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Allocated IP 172.20.0.9 (91d594ee-93aa-497d-af26-3f3353865830/6bf4d059-576f-4ff2-9b19-4983cc253018/6431ed44-bb34-4a76-bf6a-5f589562735a) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:03:18.041034 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:18.058103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Transition to ACTIVE for port object 6431ed44-bb34-4a76-bf6a-5f589562735a will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:03:18.155293 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:18.161531 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-46ac1e58-2175-4e0b-93d9-51d7f4df44ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:18.237009 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Network 91d594ee-93aa-497d-af26-3f3353865830 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:03:18.262365 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:03:18.283665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:03:18.360770 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:18.380096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.380493 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.380818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.381175 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.381530 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.381914 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.382241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.382583 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.382930 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.383272 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.383616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.383957 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:18.387832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.226s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:18.415107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:18.415750 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:18.521223 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.2174318
May 26 15:03:18.669646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72161a5c-fb3b-44a6-b204-1fb5ca76295e req-d464ad78-e12a-441a-a9fb-dce10d521b53 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:18.671015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-72161a5c-fb3b-44a6-b204-1fb5ca76295e req-d464ad78-e12a-441a-a9fb-dce10d521b53 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:03:18.702872 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c9f96136-be2c-4f5e-8a12-d232a6d30158 None None] Provisioning for port 6431ed44-bb34-4a76-bf6a-5f589562735a completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:03:18.708033 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-c9f96136-be2c-4f5e-8a12-d232a6d30158 None None] Provisioning complete for port 6431ed44-bb34-4a76-bf6a-5f589562735a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:18.708599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c9f96136-be2c-4f5e-8a12-d232a6d30158 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:18.720408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-72161a5c-fb3b-44a6-b204-1fb5ca76295e req-d464ad78-e12a-441a-a9fb-dce10d521b53 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:03:18.722110 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72161a5c-fb3b-44a6-b204-1fb5ca76295e req-d464ad78-e12a-441a-a9fb-dce10d521b53 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 931 time: 0.1429007
May 26 15:03:18.765291 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-c9f96136-be2c-4f5e-8a12-d232a6d30158 None None] Port 6431ed44-bb34-4a76-bf6a-5f589562735a cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:03:18.805510 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72161a5c-fb3b-44a6-b204-1fb5ca76295e req-20949b0a-4a9c-4a7c-80ce-1ee0d0deeda6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0776558
May 26 15:03:20.029001 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33944) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:20.150746 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.164604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:20.168389 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Usage tracker for resource:security_group_rule and tenant:af469f5fe4084a328cfbda27be471951 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:20.171382 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:20.177079 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:20.266830 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.325697 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.333562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-589f3c8c-b0e9-406e-8d81-17e5653a7a96 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:20.377127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73689bbd-708f-454f-9815-e16b50fddc40,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:20.381325 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=af469f5fe4084a328cfbda27be471951&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3512592
May 26 15:03:20.382241 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:20.383912 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 33950) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:20.443462 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.470038 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.497525 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-044d569b-0e22-4842-8cf0-e0465affd18f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.616814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.620611 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-93acc0f5-5bd7-4eba-98c8-d11db528cc36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:20.632261 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73689bbd-708f-454f-9815-e16b50fddc40,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:20.636005 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:20.639132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:20.640384 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/73689bbd-708f-454f-9815-e16b50fddc40 HTTP/1.1" status: 204  len: 168 time: 0.2555885
May 26 15:03:23.165912 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:23.167364 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-43f3d2b0-552b-46e8-b958-1111e7f7bf4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:24.046427 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:25.617040 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:29.371180 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:30.137183 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Request body: {'port': {'device_id': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:30.259408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:30.450945 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88431cf-9997-44a1-bf88-d8093b3ec60f req-4c78c3cd-1825-4996-a1bf-ab37af9bcbe5 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:30.452905 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e88431cf-9997-44a1-bf88-d8093b3ec60f req-4c78c3cd-1825-4996-a1bf-ab37af9bcbe5 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 931 time: 0.1939573
May 26 15:03:30.584000 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e88431cf-9997-44a1-bf88-d8093b3ec60f req-ab128f73-3a57-404a-bb66-d6dd842746d0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1237187
May 26 15:03:30.705002 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6431ed44-bb34-4a76-bf6a-5f589562735a {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:03:30.715395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:30.728230 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Transition to ACTIVE for port object 6431ed44-bb34-4a76-bf6a-5f589562735a will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:03:30.799615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:30.804491 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1d065f38-c54a-436a-b475-c8a3f6d3d0b4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:30.993351 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:30.998492 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.194s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:31.037980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Attempting to bind port 6431ed44-bb34-4a76-bf6a-5f589562735a on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:03:31.038311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Attempting to bind port 6431ed44-bb34-4a76-bf6a-5f589562735a by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:03:31.038636 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Attempting to bind port 6431ed44-bb34-4a76-bf6a-5f589562735a on network 91d594ee-93aa-497d-af26-3f3353865830 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:03:31.043244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Port 6431ed44-bb34-4a76-bf6a-5f589562735a on network 91d594ee-93aa-497d-af26-3f3353865830 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:03:31.043562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Attempting to bind port 6431ed44-bb34-4a76-bf6a-5f589562735a on network 91d594ee-93aa-497d-af26-3f3353865830 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:03:31.049147 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 3, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:03:31.049479 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Checking segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:03:31.049889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Bound using segment: {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:03:31.050311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Bound port: 6431ed44-bb34-4a76-bf6a-5f589562735a, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '293b87b4-e7d6-44df-8223-0904a6af3b0e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1205, 'network_id': '91d594ee-93aa-497d-af26-3f3353865830'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:03:31.050667 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:31.138998 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:03:31.145222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:03:31.195380 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:31.202878 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1bad477a-b51b-478d-ba9d-f1db33d0f772 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:31.262195 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:31.262806 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:31.264202 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] 10.222.0.32 "PUT /v2.0/ports/6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 1093 time: 1.1314600
May 26 15:03:31.264739 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:31.287566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:31.290786 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:31.429282 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a989859b-d994-43ca-a15f-8d2c08ceb896 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:31.430793 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a989859b-d994-43ca-a15f-8d2c08ceb896 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1096 time: 0.0850050
May 26 15:03:31.563100 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:03:31.576751 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-f575367e-6934-46d6-b7a2-1e59d798f332 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 217 time: 0.1382689
May 26 15:03:31.638964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-4eb44c36-b1f9-4f1d-90d2-77b3d2116763 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:31.640943 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-4eb44c36-b1f9-4f1d-90d2-77b3d2116763 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0569866
May 26 15:03:31.781449 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88afe251-555b-48a5-85e2-e632cd9c639c req-78dee0cb-e761-4e31-b88e-fb50bdcc9803 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:31.782994 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-78dee0cb-e761-4e31-b88e-fb50bdcc9803 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1349485
May 26 15:03:31.793712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98223691-17ba-4184-adc3-848346796866 req-0b301e5f-9484-495a-a458-24cb0b2baf0a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:31.795032 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98223691-17ba-4184-adc3-848346796866 req-0b301e5f-9484-495a-a458-24cb0b2baf0a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 943 time: 0.1028051
May 26 15:03:31.919579 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-98223691-17ba-4184-adc3-848346796866 req-ffdac6e5-fa4c-43ba-b21e-752eb6514730 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1040223
May 26 15:03:31.960056 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-fec7751e-1ffd-47cf-a3cc-4029b92afc95 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1641057
May 26 15:03:32.098393 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-88afe251-555b-48a5-85e2-e632cd9c639c req-a4c95e98-4803-4f63-8626-03a4d1865f60 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1314533
May 26 15:03:32.280265 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-0478df5b-9603-42d1-9eed-9537f5f56bf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:32.282259 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-0478df5b-9603-42d1-9eed-9537f5f56bf9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1096 time: 0.0727680
May 26 15:03:32.289106 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:03:32.337180 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34044) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:32.434691 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-03248fb9-bfbb-4238-b96c-b6dc2a73bf76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:32.436141 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-03248fb9-bfbb-4238-b96c-b6dc2a73bf76 service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.1455286
May 26 15:03:32.477847 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.493065 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:32.496879 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Usage tracker for resource:security_group_rule and tenant:4abf6c622ff84962a272554345009d4e is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:32.500789 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:32.506457 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:32.513516 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-9ecb0d20-34bf-4120-87bc-d80be0d5afba service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 217 time: 0.0648155
May 26 15:03:32.579507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-17eec67f-0d0a-4a48-9afa-67b93c410b62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:32.580921 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-17eec67f-0d0a-4a48-9afa-67b93c410b62 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0578640
May 26 15:03:32.590687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.645035 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.654505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f5743149-6506-47d2-8950-34c03a0c7399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:32.660712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-ee42870b-df32-4e15-acd3-9864ae305596 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:32.662275 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-ee42870b-df32-4e15-acd3-9864ae305596 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740423
May 26 15:03:32.695334 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=4abf6c622ff84962a272554345009d4e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3568926
May 26 15:03:32.697083 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e26d171-c775-4ca5-89be-67d57ec67ee0,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:32.699216 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34050) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:32.715547 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.715924 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.716288 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.716644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.716998 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.717348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.717721 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.718791 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.719150 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.719498 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.719843 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.720213 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:03:32.724132 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:32.776700 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.798953 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-cd9d563c-d647-4f23-847a-c3e845afdb8d service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1288571
May 26 15:03:32.803244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.930020 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-8533262e-28ee-41bf-a848-6e23a6a1d7b1 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1235707
May 26 15:03:32.937089 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.942019 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e9c16285-838f-4bdb-8fc8-9fa6412fe249 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:32.955034 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e26d171-c775-4ca5-89be-67d57ec67ee0,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:32.957981 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:32.960749 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:32.961902 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5e26d171-c775-4ca5-89be-67d57ec67ee0 HTTP/1.1" status: 204  len: 168 time: 0.2605741
May 26 15:03:33.111169 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f676ae2c-c89f-491e-a416-e1e66eabf875 req-6d8ccaba-d403-4d21-b167-1d650a33d693 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:33.112692 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f676ae2c-c89f-491e-a416-e1e66eabf875 req-6d8ccaba-d403-4d21-b167-1d650a33d693 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 943 time: 0.0831015
May 26 15:03:33.160307 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-f676ae2c-c89f-491e-a416-e1e66eabf875 req-e3e962c5-011d-454a-b468-e71fb7e3cdd6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:03:33.234650 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-f676ae2c-c89f-491e-a416-e1e66eabf875 req-e3e962c5-011d-454a-b468-e71fb7e3cdd6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:03:33.235793 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f676ae2c-c89f-491e-a416-e1e66eabf875 req-e3e962c5-011d-454a-b468-e71fb7e3cdd6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1174517
May 26 15:03:34.424731 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a62d63f-fd9f-46ee-b67f-32d5da604089 req-d883d4fd-068c-4167-b773-fb5b9732da7b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:34.426208 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a62d63f-fd9f-46ee-b67f-32d5da604089 req-d883d4fd-068c-4167-b773-fb5b9732da7b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 943 time: 0.0833006
May 26 15:03:34.471512 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1a62d63f-fd9f-46ee-b67f-32d5da604089 req-1b4bbb7b-d2e7-4960-9c70-e868907735a6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394502
May 26 15:03:34.789597 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6431ed44-bb34-4a76-bf6a-5f589562735a details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:03:34.958126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:34.974093 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'port_id': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'mac_address': 'fa:16:3e:3d:b9:ce', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1205, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:03:35.028117 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:35.044269 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6431ed44-bb34-4a76-bf6a-5f589562735a {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:03:35.058931 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:35.119684 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:35.122351 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:35.188105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:35.191247 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:35.356256 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:03:35.657338 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1afbc10-9729-49ca-8f07-719ac90f3e4a req-09629c0b-eec1-4d9e-afdf-8d92fd8d66ca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:35.658839 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c1afbc10-9729-49ca-8f07-719ac90f3e4a req-09629c0b-eec1-4d9e-afdf-8d92fd8d66ca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 944 time: 0.0805814
May 26 15:03:35.702874 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c1afbc10-9729-49ca-8f07-719ac90f3e4a req-bc6d23bf-90fe-42dc-9c88-a71a98cc0a8f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0383236
May 26 15:03:36.789437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6431ed44-bb34-4a76-bf6a-5f589562735a up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:03:36.893940 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db req-653228b2-485a-4a97-9f9f-014386585408 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:36.896704 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db req-653228b2-485a-4a97-9f9f-014386585408 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 944 time: 0.0860832
May 26 15:03:36.913933 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 6431ed44-bb34-4a76-bf6a-5f589562735a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:03:36.919293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 6431ed44-bb34-4a76-bf6a-5f589562735a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:36.919665 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:36.942191 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db req-4b77133e-b928-463c-ad7f-95b35cb0d1a2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405068
May 26 15:03:37.042781 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:37.077182 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:37.083014 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:37.159267 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:37.161171 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:37.227601 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:37.230586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:37.309618 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'code': 200}
May 26 15:03:37.756169 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f34f54d5-a403-4a7b-94dd-c537f7c71945 req-779545b5-b6c3-48e7-a88a-5ccca5d96ce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:37.757660 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f34f54d5-a403-4a7b-94dd-c537f7c71945 req-779545b5-b6c3-48e7-a88a-5ccca5d96ce6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1098 time: 0.0749328
May 26 15:03:37.798835 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f34f54d5-a403-4a7b-94dd-c537f7c71945 req-965c75fd-bf09-471e-802f-c4d8be82db00 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0343866
May 26 15:03:38.221740 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35c536a-e1ce-4900-af09-7810e8342f99 req-c76479e4-31ee-46d3-ad27-007f60026720 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:38.223339 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a35c536a-e1ce-4900-af09-7810e8342f99 req-c76479e4-31ee-46d3-ad27-007f60026720 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.1690860
May 26 15:03:38.267864 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a35c536a-e1ce-4900-af09-7810e8342f99 req-dd544bb6-430f-44ef-a057-deee2f1bb091 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0390563
May 26 15:03:39.483869 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e req-b3b1a69e-614b-45e1-b2dc-65cb09624dc2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:39.485344 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e req-b3b1a69e-614b-45e1-b2dc-65cb09624dc2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0902798
May 26 15:03:39.530069 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e req-8d219279-7865-4151-8dce-80e3545d5d79 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391257
May 26 15:03:39.715782 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 req-77215f0b-2125-45e8-8a49-961ef55d67fc tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:39.717219 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 req-77215f0b-2125-45e8-8a49-961ef55d67fc tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0830700
May 26 15:03:39.763209 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 req-02c623e6-8655-4aa2-93d6-9c8a8ae0727e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0400169
May 26 15:03:40.153473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 req-d0a2b9d1-74f1-4cd5-9f72-c397991ce6e0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:40.154946 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 req-d0a2b9d1-74f1-4cd5-9f72-c397991ce6e0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0808752
May 26 15:03:40.200697 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 req-d76645d2-0f7c-42b3-b3cf-69175a5a2b71 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0394020
May 26 15:03:47.549938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a09a9b-e519-4885-9866-40628524c741 req-e507914d-9d99-4902-9582-b6f33faaacac tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:47.551388 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-03a09a9b-e519-4885-9866-40628524c741 req-e507914d-9d99-4902-9582-b6f33faaacac tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0903730
May 26 15:03:47.596179 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-03a09a9b-e519-4885-9866-40628524c741 req-1124c814-4161-4b92-9a19-26c8166c2ae6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392690
May 26 15:03:48.788025 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1aa9c43-650a-455b-9efe-9cadc5b508ca req-d2bbd42d-d320-4591-a725-ecc53e5a5477 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:48.789407 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d1aa9c43-650a-455b-9efe-9cadc5b508ca req-d2bbd42d-d320-4591-a725-ecc53e5a5477 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0804596
May 26 15:03:48.834711 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d1aa9c43-650a-455b-9efe-9cadc5b508ca req-06f10f13-dca4-4719-a5f0-36abae57426a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395410
May 26 15:03:49.375471 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44a432f2-ff12-4f31-baca-287f1426814c req-c1ea1017-db70-4b46-b6ac-ba916470e95b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:49.376947 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-44a432f2-ff12-4f31-baca-287f1426814c req-c1ea1017-db70-4b46-b6ac-ba916470e95b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0843868
May 26 15:03:49.420784 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-44a432f2-ff12-4f31-baca-287f1426814c req-739a0bc7-bc3f-45b3-b190-99c6942d0b32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0382042
May 26 15:03:50.020125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3bb297-09cb-44d6-9535-c1421b749702 req-2a23c745-c5d0-4771-a1e0-6a290e5c204d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:50.021579 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7a3bb297-09cb-44d6-9535-c1421b749702 req-2a23c745-c5d0-4771-a1e0-6a290e5c204d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0816905
May 26 15:03:50.068009 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7a3bb297-09cb-44d6-9535-c1421b749702 req-8ef02f5e-9d7f-48f4-ae61-290fa8ee74f8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402582
May 26 15:03:50.490858 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5a995811-afd9-4dc5-82e4-74fb1178f164 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:50.615162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda04ee1-2500-4be2-addf-1370131534da req-de92f7dd-dcc0-4d98-865d-a65f935d1f5a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:50.616634 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bda04ee1-2500-4be2-addf-1370131534da req-de92f7dd-dcc0-4d98-865d-a65f935d1f5a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0811357
May 26 15:03:50.661467 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bda04ee1-2500-4be2-addf-1370131534da req-e861080f-3a5c-4044-a756-84fe3c9f7a52 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393157
May 26 15:03:51.239860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8582632-5233-4a46-9a90-832c9171e29b req-fdf2bcb0-88ee-436b-b1ba-49198af8e44f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:51.241333 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f8582632-5233-4a46-9a90-832c9171e29b req-fdf2bcb0-88ee-436b-b1ba-49198af8e44f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0836906
May 26 15:03:51.258599 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f req-aca0663f-2b8b-4f67-a2f3-c0c84bab25c0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:51.260043 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f req-aca0663f-2b8b-4f67-a2f3-c0c84bab25c0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0825937
May 26 15:03:51.286813 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f8582632-5233-4a46-9a90-832c9171e29b req-cbd0d0ac-f92e-48bf-8db6-832d4b043414 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0395267
May 26 15:03:51.306402 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f req-a8be1fe3-ca96-4e19-9590-5fb5bb9f12c9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404601
May 26 15:03:51.310027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 34216) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:51.538030 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-65346280-d3d2-4803-9324-ffdbdadccb83 tempest-TestMinimumBasicScenario-1255671437 tempest-TestMinimumBasicScenario-1255671437-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:51.539001 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-65346280-d3d2-4803-9324-ffdbdadccb83 tempest-TestMinimumBasicScenario-1255671437 tempest-TestMinimumBasicScenario-1255671437-project-admin] Synchronizing usage tracker for tenant:298f387c22874d8cbf8b86ab642c6bc1 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:03:51.645634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-65346280-d3d2-4803-9324-ffdbdadccb83 tempest-TestMinimumBasicScenario-1255671437 tempest-TestMinimumBasicScenario-1255671437-project-admin] Unset dirty status for tenant:298f387c22874d8cbf8b86ab642c6bc1 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:03:51.646806 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-65346280-d3d2-4803-9324-ffdbdadccb83 tempest-TestMinimumBasicScenario-1255671437 tempest-TestMinimumBasicScenario-1255671437-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1093 time: 0.3358765
May 26 15:03:51.649989 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 34224) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:51.655296 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'port_id': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'fixed_ip_address': '172.20.0.9'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:51.662039 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:51.665916 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:floatingip and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:51.668756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:51.675380 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:51.731366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for floatingip, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:51.910652 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47c7bae-9114-49e4-ab2a-fea2a193f756 req-b4f7b130-a012-45e6-af8d-f877587864c3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:51.912081 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f47c7bae-9114-49e4-ab2a-fea2a193f756 req-b4f7b130-a012-45e6-af8d-f877587864c3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1107774
May 26 15:03:51.971381 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f47c7bae-9114-49e4-ab2a-fea2a193f756 req-f4beaafc-6e96-49ca-a0c7-13072152703c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0491400
May 26 15:03:51.972816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:52.109782 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Allocated IP 172.27.2.216 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/e8457293-7703-41b8-8930-7052ec2a9bcd) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:03:52.261855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:52.354446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:52.358219 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:52.433915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:03:52.436758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:03:52.441301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:03:52.472002 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'Port': ['ID=e8457293-7703-41b8-8930-7052ec2a9bcd,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:52.478029 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:52.500008 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6c38d4-31c8-468c-b951-15b430a3eb27 req-797ab4e4-e77a-4262-9839-40f6b31da440 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:52.501476 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da6c38d4-31c8-468c-b951-15b430a3eb27 req-797ab4e4-e77a-4262-9839-40f6b31da440 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0814102
May 26 15:03:52.550685 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-da6c38d4-31c8-468c-b951-15b430a3eb27 req-26f8982a-dae3-4752-98db-71f9ce091bdc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434961
May 26 15:03:52.949054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.097302 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.098079 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.165007 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab req-dd9b4c1c-8548-486e-a9b9-8d93e414f892 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:53.166508 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab req-dd9b4c1c-8548-486e-a9b9-8d93e414f892 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0820951
May 26 15:03:53.176107 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-13518246-a0c0-4f11-b027-3503b5b63bfa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.212151 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab req-a6d7bbf2-5c67-46dc-8cef-d7fce43eb4c0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395918
May 26 15:03:53.309279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.359967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.364389 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2d55193b-6f1f-4dd6-b8b1-7b4682879747 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:53.475133 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'Port': ['ID=e8457293-7703-41b8-8930-7052ec2a9bcd,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:53.479075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:53.486043 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:53.653906 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Floating IP b36abae4-a361-45a8-8331-43ccb71c28cb associated. External IP: 172.27.2.216, port: 6431ed44-bb34-4a76-bf6a-5f589562735a.
May 26 15:03:53.885181 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-359a3acd-253e-4a74-b1ef-d450ad81fa50 req-9cefad31-8a05-4ab7-81d4-fa2a3d278597 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:53.886658 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-359a3acd-253e-4a74-b1ef-d450ad81fa50 req-9cefad31-8a05-4ab7-81d4-fa2a3d278597 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1839550
May 26 15:03:54.058497 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-359a3acd-253e-4a74-b1ef-d450ad81fa50 req-1c04e018-a191-45e7-9f8c-06b646e0d66e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1651723
May 26 15:03:54.068881 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:54.103703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Router 5f218ea9-44ea-4266-9fc8-01161ec57870 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:03:54.295674 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:03:54.306923 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Sync routers for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:03:54.316819 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:54.317571 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac42a8880>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:03:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:54.400132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:54.476837 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34246) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:54.477459 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.8260601
May 26 15:03:54.478011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:54.487835 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-931696345', 'description': 'tempest-secgroup-smoke-931696345 description', 'project_id': '83937b4f3831489289cd8aec97222f77'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:54.521560 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:54.533488 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:03:54.534006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:54.555538 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:54.599691 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc req-9a8731d2-3c5f-4d28-8fbe-ea48bef4d85c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:54.606729 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc req-9a8731d2-3c5f-4d28-8fbe-ea48bef4d85c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1117451
May 26 15:03:54.629915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-e6d1c4b8-381e-46b2-9c82-698e9de4cd29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:54.631403 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-e6d1c4b8-381e-46b2-9c82-698e9de4cd29 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1098 time: 0.0749073
May 26 15:03:54.641785 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:54.697034 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc req-5ca39225-fa30-4046-9c21-1d70af751c4c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0866883
May 26 15:03:54.719131 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:54.726166 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:54.729797 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:54.739447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:54.865368 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:54.901221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-3bd9c720-6a9a-441c-925d-9d0b2b1c539a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:54.902755 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-3bd9c720-6a9a-441c-925d-9d0b2b1c539a service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.2634814
May 26 15:03:54.916951 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac42a8880>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'b36abae4-a361-45a8-8331-43ccb71c28cb', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'floating_ip_address': '172.27.2.216', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'port_id': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'mac_address': 'fa:16:3e:3d:b9:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:03:52Z', 'updated_at': '2021-05-26T15:03:52Z', 'revision_number': 0, 'project_id': '83937b4f3831489289cd8aec97222f77', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:54.920838 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Checking router: 5f218ea9-44ea-4266-9fc8-01161ec57870 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:03:54.929211 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:03:54.929836 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac42a8880>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:03:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:54.959996 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:54.966879 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6673e5bc-6edd-4d96-9d65-1169cf11d22f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:55.008509 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroup': ['ID=26cf896a-b80b-402b-9c0b-61fd0465af2a,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:55.011519 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:55.011659 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-9e08f492-38bb-4c1c-82d2-53a172d44c04 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 999 time: 0.1008418
May 26 15:03:55.081319 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-e2c2d16c-c89a-4e72-bb8d-7cda7d35a0ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:55.082905 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-e2c2d16c-c89a-4e72-bb8d-7cda7d35a0ee service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0641611
May 26 15:03:55.091480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.096012 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.6134562
May 26 15:03:55.096313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34258) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:55.102894 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:55.112270 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:55.116480 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:55.119500 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:55.124168 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:03:55.125455 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:55.171521 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-b43fb8a0-9ea0-4b14-89d1-d9501b397aa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:55.173086 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-b43fb8a0-9ea0-4b14-89d1-d9501b397aa6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0829163
May 26 15:03:55.199514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.266423 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.354207 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.356563 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:55.372207 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-ffddfe53-0c80-4313-8c3f-183c5b52c08c service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1571496
May 26 15:03:55.380424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf243e34-83df-4321-818b-ff6d36a9d24b req-e6478356-2220-4cf9-828d-b0d81712c1a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:55.380899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2bbae999-0e86-4b7f-8650-9a6d6585981b,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:55.381578 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bf243e34-83df-4321-818b-ff6d36a9d24b req-e6478356-2220-4cf9-828d-b0d81712c1a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.2021825
May 26 15:03:55.389665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:55.474190 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.478039 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3783984
May 26 15:03:55.479511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34262) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:55.483616 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:55.489360 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:55.493805 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:55.497289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:55.504864 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:55.510163 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bf243e34-83df-4321-818b-ff6d36a9d24b req-7e4eb94a-70b4-4ed3-adeb-a800239bfbfc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1092956
May 26 15:03:55.526744 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac42a8880>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'b36abae4-a361-45a8-8331-43ccb71c28cb', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'floating_ip_address': '172.27.2.216', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'port_id': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'mac_address': 'fa:16:3e:3d:b9:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:03:52Z', 'updated_at': '2021-05-26T15:03:52Z', 'revision_number': 0, 'project_id': '83937b4f3831489289cd8aec97222f77', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:03:55.530965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c18a4527-1af1-47d1-a80b-16bb11e29b79 None None] The sync data for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi is: [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': 'b36abae4-a361-45a8-8331-43ccb71c28cb', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'floating_ip_address': '172.27.2.216', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'port_id': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'mac_address': 'fa:16:3e:3d:b9:ce', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:03:52Z', 'updated_at': '2021-05-26T15:03:52Z', 'revision_number': 0, 'project_id': '83937b4f3831489289cd8aec97222f77', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:03:55.553979 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-dec634ca-c8c5-430b-a5b9-eb78aed4c8ec service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1714768
May 26 15:03:55.597498 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.617160 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.652719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.730637 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f1a27ef-d2d9-4102-b359-1471809396d7 None None] New status for floating IP b36abae4-a361-45a8-8331-43ccb71c28cb: ACTIVE {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:03:55.748583 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.751186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-37260363-acf0-4ee0-b696-b16435d02bd2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:55.775666 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=91285ec3-7fb8-4465-bfce-b9f3a6679e55,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:55.785158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:55.866472 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:55.870605 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3a2aec51-718c-4a78-8c31-7e19f6f26853 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3885603
May 26 15:03:55.870825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 34270) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:55.877329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:55.883644 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:55.887874 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:55.891573 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:55.899174 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:55.910994 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3cb7b7c-43ea-4823-8998-ea3b93abbece req-8a4bba56-dc19-47eb-a723-83f77e828c50 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:55.912527 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b3cb7b7c-43ea-4823-8998-ea3b93abbece req-8a4bba56-dc19-47eb-a723-83f77e828c50 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0961802
May 26 15:03:56.038311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.053434 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b3cb7b7c-43ea-4823-8998-ea3b93abbece req-1fb89ff6-c25a-4d53-bb42-3ef6e7d3dec4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1342347
May 26 15:03:56.106604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.165400 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.171454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-305774e4-ec3c-42b8-81dd-0fc3d503767b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:56.191558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fe6fe229-0cd6-42d5-a147-05a1e223fe24,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:56.195973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:56.284623 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.285857 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4140165
May 26 15:03:56.288643 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 34278) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:56.293789 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:56.300343 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:56.304288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:56.307244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:56.313497 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:56.399780 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.471119 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.559528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.561611 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:56.585121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66fb2c01-d8d6-4be4-9358-821c894175eb,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:56.586948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:56.645653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.646852 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0582cd3c-6f4c-4f68-bf69-148a2abbda5f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3572824
May 26 15:03:56.649828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 34288) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:56.654983 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:56.661915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:56.665825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:56.668710 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:56.674473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:56.703608 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1674fbc5-4583-46e7-a38e-9b94771c1c55 req-bb13c736-5787-44cf-b350-ba72f6e9dfe4 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:56.705082 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1674fbc5-4583-46e7-a38e-9b94771c1c55 req-bb13c736-5787-44cf-b350-ba72f6e9dfe4 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0809917
May 26 15:03:56.725070 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.securitygroups_db [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Project 83937b4f3831489289cd8aec97222f77 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:03:56.731702 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.756752 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1674fbc5-4583-46e7-a38e-9b94771c1c55 req-47f5bd75-9a6f-4e44-acfd-e063d2b336a3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443699
May 26 15:03:56.805880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.868409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.877120 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2d1a3d65-3a88-4106-8f48-a25ca3ec9454 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:56.898769 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=27657298-fa6a-474c-be48-8fe5ef7a9efc,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:56.901804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:56.966180 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:56.967397 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-80c4cbbb-5bcf-46e8-9553-34ef8a3cd785 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3166442
May 26 15:03:56.970428 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34294) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:03:56.975970 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'security_group_rule': {'security_group_id': '26cf896a-b80b-402b-9c0b-61fd0465af2a', 'project_id': '83937b4f3831489289cd8aec97222f77', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:56.981918 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:03:56.985795 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Usage tracker for resource:security_group_rule and tenant:83937b4f3831489289cd8aec97222f77 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:03:56.988778 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:03:56.995095 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:03:57.074840 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.securitygroups_db [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Project 83937b4f3831489289cd8aec97222f77 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:03:57.081791 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:57.147354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:57.222611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:57.224706 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-60334ed4-a618-4071-9a6f-30071c4b9d64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:57.246869 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b67a5b9-5893-4c37-b5c9-8f07e9a06991,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:57.249302 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:57.250376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d req-d5e2d7f6-74eb-4f7f-8996-0b27cd5cbd99 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:57.251875 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d req-d5e2d7f6-74eb-4f7f-8996-0b27cd5cbd99 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0842075
May 26 15:03:57.296756 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d req-b8ffbc24-0d85-424b-90e3-6d99adb8d259 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392761
May 26 15:03:57.314155 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:57.315418 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e9e91851-a26b-4f66-870a-c5e9249e5d1b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3439815
May 26 15:03:57.435645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-fabff5e1-d4c0-4735-a4be-82db3ea8a880 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:03:57.502267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-fabff5e1-d4c0-4735-a4be-82db3ea8a880 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:03:57.503464 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-fabff5e1-d4c0-4735-a4be-82db3ea8a880 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-931696345&fields=id&tenant_id=83937b4f3831489289cd8aec97222f77 HTTP/1.1" status: 200  len: 267 time: 0.1072474
May 26 15:03:57.591004 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-02454aa2-2c1d-4be4-8f85-7087a71331d2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:57.592540 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-02454aa2-2c1d-4be4-8f85-7087a71331d2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0835292
May 26 15:03:57.603446 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'port': {'security_groups': ['4c346a6a-0742-44bc-b430-b584c9e11507', '26cf896a-b80b-402b-9c0b-61fd0465af2a']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:03:57.717752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:57.951926 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca req-7900f07c-02d2-41af-9b44-57a674cfeb95 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:57.953517 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca req-7900f07c-02d2-41af-9b44-57a674cfeb95 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0844219
May 26 15:03:57.980463 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:03:57.998034 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca req-3d29f69a-c249-4c5d-a16c-ecb44a05a02f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0386264
May 26 15:03:58.007264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:58.073715 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:58.079275 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2d43d91a-46e0-4339-9c5a-2dd8b5967841 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:03:58.088918 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:03:58.148879 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.149404 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:58.150840 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "PUT /v2.0/ports/6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 981 time: 0.5518179
May 26 15:03:58.151360 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:03:58.178928 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=6']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:03:58.187244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2da50c36-8921-4e8f-a283-6ea8dc119e8a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:03:58.248081 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:03:58.253589 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:03:58.421820 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-4314b64e-7b1a-4ccd-849c-02182284d024 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.423389 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-4314b64e-7b1a-4ccd-849c-02182284d024 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1137 time: 0.1481593
May 26 15:03:58.431944 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 req-16d3e569-afae-4e03-a9b7-3816066b8682 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.433441 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 req-16d3e569-afae-4e03-a9b7-3816066b8682 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.1169665
May 26 15:03:58.511504 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff req-a18ddae7-31c6-497f-9c5a-3c0a995cef2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.513105 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff req-a18ddae7-31c6-497f-9c5a-3c0a995cef2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0844173
May 26 15:03:58.554466 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-208d513a-d894-4d60-9664-bdaee9ceddf9 None None] Provisioning complete for port 6431ed44-bb34-4a76-bf6a-5f589562735a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:03:58.554828 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-208d513a-d894-4d60-9664-bdaee9ceddf9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:58.561515 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff req-77badfa7-8a00-4e42-87d6-58306234e0c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419269
May 26 15:03:58.576913 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 req-278400a4-8bcb-4cb6-9ba2-c8fd9a5c8ffe tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.1026931
May 26 15:03:58.632430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-6c65d93d-3eef-4e1b-8b1b-4470f848b445 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.633896 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-6c65d93d-3eef-4e1b-8b1b-4470f848b445 service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.1995089
May 26 15:03:58.736779 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-a91aa073-84ab-429b-a271-29ed9587b7f8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 1001 time: 0.0939970
May 26 15:03:58.887757 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-ac09c231-d818-409e-a0ca-1fdba6ce0461 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.889278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-ac09c231-d818-409e-a0ca-1fdba6ce0461 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.1460788
May 26 15:03:58.966858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-cad690cd-177b-4fdc-9ce7-9264c324f26d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:58.968965 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-cad690cd-177b-4fdc-9ce7-9264c324f26d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0729105
May 26 15:03:59.103535 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-ec0a05be-5ac4-41f1-bcc1-6b11a1cddac4 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1267979
May 26 15:03:59.195975 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b req-a5ef7d48-60c4-4125-a416-25124d9a3312 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:59.197422 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b req-a5ef7d48-60c4-4125-a416-25124d9a3312 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0834465
May 26 15:03:59.238166 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-5fff0175-3624-49bc-8376-2528573e7009 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1275306
May 26 15:03:59.244247 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b req-bd289577-1fea-4249-b99a-bfe234ca5911 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390544
May 26 15:03:59.382360 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:03:59.781242 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9104f7e4-760a-4815-a650-eddd473f344c req-9d7f5801-f162-4fdb-b9a1-974dd3f1d7a5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:03:59.782796 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9104f7e4-760a-4815-a650-eddd473f344c req-9d7f5801-f162-4fdb-b9a1-974dd3f1d7a5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1066806
May 26 15:03:59.830515 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9104f7e4-760a-4815-a650-eddd473f344c req-4eba2d4a-edad-4ff6-9ae2-400bf061c813 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418968
May 26 15:04:00.427215 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41dbc3e6-1985-43c0-a698-7e8d57031c01 req-756f7813-9286-434c-a242-687749636b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:00.428678 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-41dbc3e6-1985-43c0-a698-7e8d57031c01 req-756f7813-9286-434c-a242-687749636b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0812223
May 26 15:04:00.474280 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-41dbc3e6-1985-43c0-a698-7e8d57031c01 req-23a08ba4-dd18-40a5-9edc-15c397b20d58 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399714
May 26 15:04:00.867116 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:04:01.000862 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:01.014090 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:04:01.021991 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704d5848-3f7a-4716-acc0-b3b4b734a280 req-30f4be9a-9ca0-4436-acae-3294d2a636f3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.023979 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-704d5848-3f7a-4716-acc0-b3b4b734a280 req-30f4be9a-9ca0-4436-acae-3294d2a636f3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0821459
May 26 15:04:01.070830 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:01.072735 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-704d5848-3f7a-4716-acc0-b3b4b734a280 req-51d57163-80a6-4e43-9c9d-44f0b70f74e2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430198
May 26 15:04:01.089134 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:04:01.105617 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:01.239569 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:01.241345 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:01.313910 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=6']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:01.321100 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.321445 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.321806 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.322135 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.322461 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.322783 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.323104 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.323425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.323748 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.324064 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.324378 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.324690 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:01.329132 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:01.343093 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['d9f82690-b757-4c6f-b288-d20d193f4031'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:04:01.376480 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-4004a765-8f3b-44a2-b5c4-8a18af3a0ede service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.377967 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-4004a765-8f3b-44a2-b5c4-8a18af3a0ede service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1097 time: 0.0709677
May 26 15:04:01.523004 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-35b3f5d4-c107-4073-9e7b-eb0178937414 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.524707 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-35b3f5d4-c107-4073-9e7b-eb0178937414 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.1275928
May 26 15:04:01.631681 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-4dde5d7f-edee-4f22-ba19-9e2e79489846 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 1000 time: 0.0962853
May 26 15:04:01.667927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a req-7023fb05-297c-4997-85b1-80caece7cdd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.669399 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a req-7023fb05-297c-4997-85b1-80caece7cdd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0840139
May 26 15:04:01.696893 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-78a8c15f-7a76-4014-9e98-533a17e81d1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.698332 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-78a8c15f-7a76-4014-9e98-533a17e81d1c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0577407
May 26 15:04:01.715119 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a req-6027246d-094d-44e1-8308-9ffb5d4146a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0387566
May 26 15:04:01.776731 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-3918f669-2bc3-4f8f-8215-3ac2483510c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:01.778187 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-3918f669-2bc3-4f8f-8215-3ac2483510c4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714147
May 26 15:04:01.911627 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-e0bb0e0a-ade8-47cf-8a9a-f927caea524e service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251249
May 26 15:04:02.045203 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6dc05430-5ced-4861-8e03-ca900a7941a8 req-f04af2ff-c6ab-4570-aace-b097e3cdc784 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1238861
May 26 15:04:02.272847 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffd08500-a3ff-44b0-b604-1073dba6e95a req-e35ec0a4-fd9a-4909-9ddf-c891d9bd0d84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:02.274690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ffd08500-a3ff-44b0-b604-1073dba6e95a req-e35ec0a4-fd9a-4909-9ddf-c891d9bd0d84 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.0891566
May 26 15:04:02.329137 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ffd08500-a3ff-44b0-b604-1073dba6e95a req-fbdc9eac-cc60-4a06-856d-14e185df987e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0472100
May 26 15:04:02.746166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-a962b50f-c6e3-45e8-b6be-061b65dc4f8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:02.747653 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-a962b50f-c6e3-45e8-b6be-061b65dc4f8e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0785048
May 26 15:04:02.878681 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:04:02.914937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 req-f89f0304-838f-4507-b623-5eedaca3d9eb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:02.916481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 req-f89f0304-838f-4507-b623-5eedaca3d9eb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0894997
May 26 15:04:03.003255 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 req-cfd0a7fc-26a0-4f3a-a5db-3ba781fa6ab6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0806100
May 26 15:04:03.013796 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-a4bd3f39-7906-4eaf-870b-1e20f5be24f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:03.015920 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-a4bd3f39-7906-4eaf-870b-1e20f5be24f2 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.2606268
May 26 15:04:03.018531 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port d9f82690-b757-4c6f-b288-d20d193f4031 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:04:03.018902 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:03.149422 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-d2c33d50-e30a-4de4-bd1a-41dc68c2ff16 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 1000 time: 0.1222625
May 26 15:04:03.226560 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:03.254427 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-78ec6c17-4525-48e1-ad36-99d7e42817de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:03.256002 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-78ec6c17-4525-48e1-ad36-99d7e42817de service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0975654
May 26 15:04:03.262550 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:03.275152 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:03.320068 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'code': 200}
May 26 15:04:03.360554 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:03.364092 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:03.400483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-b835d016-045f-4086-b72b-e6daf24a5e17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:03.410028 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-b835d016-045f-4086-b72b-e6daf24a5e17 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1437778
May 26 15:04:03.513786 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=7']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:03.522042 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:03.592243 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 req-1c56a975-4a7c-441c-9c1e-6fe46e1c5a24 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:03.599519 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-eaf3bd7e-9df5-46cb-8f4b-fb279f3e2d68 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1822610
May 26 15:04:03.602886 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 req-1c56a975-4a7c-441c-9c1e-6fe46e1c5a24 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1166193
May 26 15:04:03.644826 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 req-71b12355-9982-45af-aea3-6d754aaee49c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0422521
May 26 15:04:03.768907 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-da95cccf-928f-4116-8054-8d7dcf1d509f req-d16d6d21-21d1-44da-b67d-745b2e90879d service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1624436
May 26 15:04:04.267715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2aeac81-1a19-4588-a26f-3221e202bc8e req-844c267f-886d-43ab-99e1-dd5aa53a3d74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:04.267715 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d2aeac81-1a19-4588-a26f-3221e202bc8e req-844c267f-886d-43ab-99e1-dd5aa53a3d74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1023524
May 26 15:04:04.322198 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d2aeac81-1a19-4588-a26f-3221e202bc8e req-e687a2b2-2356-4726-8934-ab2e7686f781 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0821133
May 26 15:04:04.888940 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-974c188e-cafb-49b2-8bf6-d2782eb48287 req-dd3be37e-4478-48b8-84f5-600f3bf3c627 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:04.890655 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-974c188e-cafb-49b2-8bf6-d2782eb48287 req-dd3be37e-4478-48b8-84f5-600f3bf3c627 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0953410
May 26 15:04:04.950249 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-974c188e-cafb-49b2-8bf6-d2782eb48287 req-c6f03e5c-5f6a-49ef-8b0d-c13f8a96911a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0535429
May 26 15:04:05.601985 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 req-a3d19315-1532-4d30-a71f-ee3ff90f70d9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:05.603864 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 req-a3d19315-1532-4d30-a71f-ee3ff90f70d9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1423576
May 26 15:04:05.689425 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 req-3740a07d-d797-46ea-8c70-b72423dfd0f4 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0797551
May 26 15:04:06.231799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad6572f-1b94-4409-bc31-b77660ac8d38 req-ae027fc4-cc0c-4108-bc88-3c7f02efe919 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:06.233184 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6ad6572f-1b94-4409-bc31-b77660ac8d38 req-ae027fc4-cc0c-4108-bc88-3c7f02efe919 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1526656
May 26 15:04:06.279490 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6ad6572f-1b94-4409-bc31-b77660ac8d38 req-e34ac8eb-f69b-4da5-a005-e7c95387e418 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0399718
May 26 15:04:06.933368 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323197cd-4a90-4162-af2d-3ebb70848216 req-1bd466cd-fde8-46d2-8699-e0f529c3a649 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:06.935884 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-323197cd-4a90-4162-af2d-3ebb70848216 req-1bd466cd-fde8-46d2-8699-e0f529c3a649 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1114733
May 26 15:04:07.013041 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-323197cd-4a90-4162-af2d-3ebb70848216 req-f6ac9106-86db-4889-9589-9c9bf22e1b41 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0691278
May 26 15:04:07.499901 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 req-3725f364-bcef-4104-a21a-dd57e6e6c6d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:07.501629 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 req-3725f364-bcef-4104-a21a-dd57e6e6c6d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1006684
May 26 15:04:07.565087 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 req-fce8ca9c-f96b-42f5-a9ee-ad2dd2252f92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0560653
May 26 15:04:08.212240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d req-c13f2cae-64f5-4d05-8772-ad0bc815d19f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:08.219232 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d req-c13f2cae-64f5-4d05-8772-ad0bc815d19f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0893052
May 26 15:04:08.263854 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d req-b18d1eef-5676-48bd-abe5-b7cfff255d66 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0437515
May 26 15:04:08.946231 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:08.964011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d975673-cc47-4519-9025-189c41711a55 req-2ad7b8d8-89f4-4cc9-b12b-07838b7713ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:08.972044 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d975673-cc47-4519-9025-189c41711a55 req-2ad7b8d8-89f4-4cc9-b12b-07838b7713ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1555035
May 26 15:04:08.993329 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc req-bb181013-5b41-45c2-8bcb-a9a6d326ee54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:08.995958 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc req-bb181013-5b41-45c2-8bcb-a9a6d326ee54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.2827501
May 26 15:04:09.022690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-70655b89-e021-4482-a5d4-bb1d16783b12 service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.3141913
May 26 15:04:09.132018 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d975673-cc47-4519-9025-189c41711a55 req-4441c31c-350b-4b2b-9872-e0751586d5ae tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1585438
May 26 15:04:09.180289 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc req-ef0f2e48-7871-4d24-8368-d3d2c4936ba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1774588
May 26 15:04:09.191388 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:09.219276 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:09.229223 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:09.260789 dv-cinder-784140-4-iscsi neutron-server[103983]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'code': 422} returned with failed status
May 26 15:04:09.355950 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:04:09.628224 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:09.630140 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-c4ee2bbd-93cf-4c7f-ad21-030c85e8b3d7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:09.696640 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=6']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:09.700008 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:10.419870 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e req-bf59090c-b034-4d48-a279-ac785c6c2735 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:10.429593 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e req-bf59090c-b034-4d48-a279-ac785c6c2735 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1043229
May 26 15:04:10.436281 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f3c619-c580-4211-83ac-162e55b2c807 req-e4e57ea5-a4a9-461a-90cf-2424e5acf5e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:10.438591 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-83f3c619-c580-4211-83ac-162e55b2c807 req-e4e57ea5-a4a9-461a-90cf-2424e5acf5e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0948863
May 26 15:04:10.492115 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e req-dfec85ac-2e78-43a6-ab40-cce7b69b75b9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0613804
May 26 15:04:10.496607 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-83f3c619-c580-4211-83ac-162e55b2c807 req-77b367d4-577e-447d-a627-bdba87f07963 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0505059
May 26 15:04:11.722832 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 req-44a76389-9617-4f07-8502-2116dfbffe0b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:11.725025 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 req-44a76389-9617-4f07-8502-2116dfbffe0b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1060982
May 26 15:04:11.756324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ca3eb7-4b91-40db-9c62-0dd2b720367e req-879b6d0d-5df8-479a-af27-dd7036b07540 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:11.757912 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-65ca3eb7-4b91-40db-9c62-0dd2b720367e req-879b6d0d-5df8-479a-af27-dd7036b07540 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1092944
May 26 15:04:11.775749 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 req-a1a9f6dc-4f15-41e8-a6b9-bfa23453dcf0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0445743
May 26 15:04:11.819356 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-65ca3eb7-4b91-40db-9c62-0dd2b720367e req-33962488-9fca-43a0-a846-bcc601deb286 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0555179
May 26 15:04:12.971753 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0185661-7004-4782-8f2b-60d727c87632 req-a4c3718d-ebf0-48a6-830b-f67dc633c136 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:12.973226 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d0185661-7004-4782-8f2b-60d727c87632 req-a4c3718d-ebf0-48a6-830b-f67dc633c136 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0879543
May 26 15:04:13.022438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca59681d-6c32-4ee0-963b-e7285387baf7 req-f0556c85-669d-47e5-9935-6edce2f827da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:13.024196 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca59681d-6c32-4ee0-963b-e7285387baf7 req-f0556c85-669d-47e5-9935-6edce2f827da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0915062
May 26 15:04:13.026060 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d0185661-7004-4782-8f2b-60d727c87632 req-0ce0b11d-521a-43df-bb31-ae01efccafee tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0470037
May 26 15:04:13.081534 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca59681d-6c32-4ee0-963b-e7285387baf7 req-bbca6e47-d2d8-4403-bb78-2f987a3d411f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0515878
May 26 15:04:14.214053 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faae0a8-82ae-4179-abb1-3735626afeec req-b1bc5e43-e712-4d5c-9cac-a912bd5b8b60 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:14.215516 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9faae0a8-82ae-4179-abb1-3735626afeec req-b1bc5e43-e712-4d5c-9cac-a912bd5b8b60 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0818925
May 26 15:04:14.259967 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9faae0a8-82ae-4179-abb1-3735626afeec req-b56e192d-3a96-40b3-a3f4-813c0debffa7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0388043
May 26 15:04:14.283743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0916efa8-9135-442d-9536-e1cd100cf347 req-c89cb212-90bd-40c7-a906-9ba67ee8e2c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:14.285175 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0916efa8-9135-442d-9536-e1cd100cf347 req-c89cb212-90bd-40c7-a906-9ba67ee8e2c9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.0841658
May 26 15:04:14.329037 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0916efa8-9135-442d-9536-e1cd100cf347 req-e12d017d-0049-4e60-b8fd-95ca2f7ba204 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381019
May 26 15:04:14.806406 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-c513648e-69c2-4d59-81eb-5de866ae9b12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:14.807744 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-c513648e-69c2-4d59-81eb-5de866ae9b12 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1098 time: 0.0719674
May 26 15:04:14.936299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-5312c975-9efc-4643-8b6b-ca73ae3022fc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:14.937797 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-5312c975-9efc-4643-8b6b-ca73ae3022fc service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.1225657
May 26 15:04:15.112368 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-a538d7d3-ed51-4fc4-a2d3-4aebfd337fcf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 1001 time: 0.1674533
May 26 15:04:15.175619 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-eda94cc3-6f62-484c-ad2b-35dec34b9742 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:15.177029 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-eda94cc3-6f62-484c-ad2b-35dec34b9742 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0577714
May 26 15:04:15.255309 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-080a9884-8fad-47c4-ad36-7fdf8a3ce2b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:15.256764 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-080a9884-8fad-47c4-ad36-7fdf8a3ce2b8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0721836
May 26 15:04:15.401441 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-10982de3-648a-4a93-a430-1e7e890f27ba service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1379802
May 26 15:04:15.472884 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3577a857-1b87-4ac8-ba9a-4004a8711f00 req-98288b8f-6d1e-4205-8687-3532d952200b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:15.474421 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3577a857-1b87-4ac8-ba9a-4004a8711f00 req-98288b8f-6d1e-4205-8687-3532d952200b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1029954
May 26 15:04:15.519968 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3577a857-1b87-4ac8-ba9a-4004a8711f00 req-c6b81fe2-a8c0-4cce-ad5d-3174219f6355 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394280
May 26 15:04:15.592908 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-eca7ed95-99ba-4281-8877-90d8d4800865 req-5a130a5a-09ce-4d08-9454-b60fd9e6aac6 service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1844473
May 26 15:04:15.612689 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a67485f-0a33-410a-95e0-616c44a47942 req-935e2c3a-4410-4fb8-9a1e-4956edf35275 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:15.612898 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0a67485f-0a33-410a-95e0-616c44a47942 req-935e2c3a-4410-4fb8-9a1e-4956edf35275 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1329360
May 26 15:04:15.663258 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0a67485f-0a33-410a-95e0-616c44a47942 req-365c5bd5-5d04-4ac5-b937-fed0a5bd1dad tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0446398
May 26 15:04:16.129904 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b18263-3724-46e7-b87c-81f0ed29bc0c req-756af1c5-6622-4ba2-8ea9-1b3c3e602772 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.132034 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f1b18263-3724-46e7-b87c-81f0ed29bc0c req-756af1c5-6622-4ba2-8ea9-1b3c3e602772 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0844927
May 26 15:04:16.232035 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f1b18263-3724-46e7-b87c-81f0ed29bc0c req-774f4114-fde2-4832-8e42-ed06691afaad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0947800
May 26 15:04:16.251108 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-54cd70dd-9b14-4df6-b862-c2e89afa2af3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.252448 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-54cd70dd-9b14-4df6-b862-c2e89afa2af3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1137 time: 0.1016676
May 26 15:04:16.393226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-ccc91bf9-60cc-4256-b54e-31556352b707 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.394788 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-ccc91bf9-60cc-4256-b54e-31556352b707 service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.1337323
May 26 15:04:16.508863 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-04d09b43-d7f5-446b-ae4c-277a9cd02696 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 1001 time: 0.1060560
May 26 15:04:16.584124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-e6b4f453-f09f-4dd0-8890-4a62ef9e8c9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.585629 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-e6b4f453-f09f-4dd0-8890-4a62ef9e8c9f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0687931
May 26 15:04:16.663654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-394e5e4e-7852-4aa6-861a-ad92776196da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.665119 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-394e5e4e-7852-4aa6-861a-ad92776196da service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725901
May 26 15:04:16.724338 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94783651-3dc1-4214-b167-da296d2eeb70 req-8253721e-5a97-466e-85a1-c126013a7dc0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:16.725812 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-94783651-3dc1-4214-b167-da296d2eeb70 req-8253721e-5a97-466e-85a1-c126013a7dc0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0860815
May 26 15:04:16.775975 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-94783651-3dc1-4214-b167-da296d2eeb70 req-e0f1c650-c8ea-47a5-aaef-9b951d359c15 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435431
May 26 15:04:16.815690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-9f1b4f26-d5dc-4cb1-bc84-aa81b696d287 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1406980
May 26 15:04:16.995536 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:17.020934 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95c342b4-143a-4424-abf7-77f77e5c1279 req-f280e398-506d-4bac-9cb8-60eade5a62b5 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1934226
May 26 15:04:17.034426 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e req-036023cc-2828-45d1-b44c-9d00fa471ef8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:17.035817 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e req-036023cc-2828-45d1-b44c-9d00fa471ef8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 945 time: 0.1345401
May 26 15:04:17.083716 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e req-e3c57ad9-8158-45ee-8977-3831f4c32d7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410957
May 26 15:04:17.126266 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:17.153599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:17.164565 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:17.200109 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'code': 200}
May 26 15:04:17.233782 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:17.236275 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:17.307121 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=8']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:17.310897 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:17.426660 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5908986-8f86-45ef-bdaa-f1137c7c5808 req-f0201342-08ea-4495-9acc-6f3b73f68822 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:17.428125 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5908986-8f86-45ef-bdaa-f1137c7c5808 req-f0201342-08ea-4495-9acc-6f3b73f68822 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0836353
May 26 15:04:17.478965 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5908986-8f86-45ef-bdaa-f1137c7c5808 req-c2a7ec9e-bde5-480a-ae1d-c9f377602427 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0450928
May 26 15:04:17.720467 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-93adb4e1-d88f-4c98-a3dd-bd18017d9093 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:17.721976 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-93adb4e1-d88f-4c98-a3dd-bd18017d9093 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de&tenant_id=07c65d1e254f424ebfea8360aa697c34 HTTP/1.1" status: 200  len: 1096 time: 0.1511154
May 26 15:04:17.862487 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-2b5b57f1-bd9c-4230-b92c-2f77577c438e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:17.863947 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-2b5b57f1-bd9c-4230-b92c-2f77577c438e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1096 time: 0.0769968
May 26 15:04:17.978249 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93771bc3-644d-4a1d-8973-e53844576f28 req-a90a8698-146a-4617-8502-8f26e19a58a5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:17.979740 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93771bc3-644d-4a1d-8973-e53844576f28 req-a90a8698-146a-4617-8502-8f26e19a58a5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0874102
May 26 15:04:18.009007 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-f3608904-0132-4cf8-8494-cdcade343219 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:18.010465 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-f3608904-0132-4cf8-8494-cdcade343219 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.1396306
May 26 15:04:18.029519 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-93771bc3-644d-4a1d-8973-e53844576f28 req-1e445650-17ea-4c09-8463-19d8f4ec21bb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0421722
May 26 15:04:18.128456 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-e81e4f15-00af-4e0d-901d-e92b56c55f7f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 998 time: 0.1081312
May 26 15:04:18.200809 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-e777d287-466f-4130-86d7-73bbe75f9690 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:18.202278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-e777d287-466f-4130-86d7-73bbe75f9690 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0614777
May 26 15:04:18.340815 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c159e281-2874-49a6-84d3-20ff19d64ddf req-47de455a-8b14-4aba-993b-2b576045eda6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:18.342375 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c159e281-2874-49a6-84d3-20ff19d64ddf req-47de455a-8b14-4aba-993b-2b576045eda6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.1392391
May 26 15:04:18.345512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-8ce88e2f-1720-4da9-b8a7-5d8827a52bfe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:18.346853 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-8ce88e2f-1720-4da9-b8a7-5d8827a52bfe service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1140149
May 26 15:04:18.467441 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c159e281-2874-49a6-84d3-20ff19d64ddf req-2475a230-1d21-4314-8ea8-31056c86afe3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1187434
May 26 15:04:18.516184 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-64265557-0dc5-4ef8-8671-280dd80686de service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1542668
May 26 15:04:18.709512 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-8f0fafe9-38ed-4583-bc5b-8ff74e0d97dd service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1867862
May 26 15:04:18.728569 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce10a85-306d-40af-a166-08843099569e req-d139fc51-05ac-4c29-bec2-2c5480991323 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:18.729948 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cce10a85-306d-40af-a166-08843099569e req-d139fc51-05ac-4c29-bec2-2c5480991323 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.1237001
May 26 15:04:18.777741 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cce10a85-306d-40af-a166-08843099569e req-f0429c6a-e833-49fe-b0a1-1d27a36e5287 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0414944
May 26 15:04:19.216074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae395e2-29ac-4a75-a03e-610a36dd0214 req-309e2152-5b2c-4e54-a540-18bf5204e24a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:19.217518 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1ae395e2-29ac-4a75-a03e-610a36dd0214 req-309e2152-5b2c-4e54-a540-18bf5204e24a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0794115
May 26 15:04:19.264924 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1ae395e2-29ac-4a75-a03e-610a36dd0214 req-fe087948-13fc-4be4-84d4-42ff512aec87 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415387
May 26 15:04:19.981493 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-929df4cb-08d5-4881-b64c-5c0073b53d0e req-5feff92b-f612-43ea-b53c-76fbe5bb472c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:19.982985 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-929df4cb-08d5-4881-b64c-5c0073b53d0e req-5feff92b-f612-43ea-b53c-76fbe5bb472c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0872893
May 26 15:04:20.032861 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-929df4cb-08d5-4881-b64c-5c0073b53d0e req-4edf5b7d-7c85-4d97-9755-4d8049717ad1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0429084
May 26 15:04:20.463053 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b req-9b25a876-610e-4c99-a9f0-cb16a8edcead tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:20.464644 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b req-9b25a876-610e-4c99-a9f0-cb16a8edcead tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0940080
May 26 15:04:20.502815 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b0c1faa2-915e-4dca-8ae8-bf5877933821 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:20.517727 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b req-24e4d5f8-a0e6-446c-98f9-6cb872bd08ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0459445
May 26 15:04:21.008579 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:21.055282 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8df9894c-8e32-4977-b56c-023d39a7a292 req-a8c25fda-2ab8-48d9-8ada-e558b446351c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:21.058207 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8df9894c-8e32-4977-b56c-023d39a7a292 req-a8c25fda-2ab8-48d9-8ada-e558b446351c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0892806
May 26 15:04:21.155818 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8df9894c-8e32-4977-b56c-023d39a7a292 req-a0ca09b3-5790-4e25-8902-2d6f8e1b87c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0871584
May 26 15:04:21.276283 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a req-c45d2716-0928-4e3f-a7b2-b00c75bf3c95 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:21.277815 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a req-c45d2716-0928-4e3f-a7b2-b00c75bf3c95 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0903003
May 26 15:04:21.328063 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a req-0920be89-12cd-4bf8-8ad0-a930b8251928 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0427737
May 26 15:04:21.520476 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34588) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:21.676494 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-1a33875d-cbb7-4caa-8ad7-59fe5e8377e2 service neutron] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1547155
May 26 15:04:21.723472 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 req-2837fcb0-5ba7-41fa-b150-a64740a28c89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:21.725698 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 req-2837fcb0-5ba7-41fa-b150-a64740a28c89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0935719
May 26 15:04:21.781569 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 req-561f28c5-8764-4dcb-9863-0ab98b4662f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475507
May 26 15:04:21.933922 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4124b4f-ea88-4fc2-ad14-61681f68d722 req-6df1e41f-48d5-45d8-a588-053dce50f2ce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:21.935355 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e4124b4f-ea88-4fc2-ad14-61681f68d722 req-6df1e41f-48d5-45d8-a588-053dce50f2ce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.0852785
May 26 15:04:21.985948 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e4124b4f-ea88-4fc2-ad14-61681f68d722 req-1ae01b49-7553-4de8-bda9-dbab844e834c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441294
May 26 15:04:22.354990 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ecda1e-689e-4219-829e-c108e7601fe9 req-87d36aea-779d-4d4f-b82d-37599c1993de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:22.356481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-32ecda1e-689e-4219-829e-c108e7601fe9 req-87d36aea-779d-4d4f-b82d-37599c1993de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0822396
May 26 15:04:22.407785 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-32ecda1e-689e-4219-829e-c108e7601fe9 req-326bca1b-34f3-4e02-9d37-7990ff2764e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0443418
May 26 15:04:22.518716 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b009638-ba2a-4557-839b-383a71587ec0 req-5104c9be-3d7f-498b-823d-e1d5587099f9 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:22.520190 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0b009638-ba2a-4557-839b-383a71587ec0 req-5104c9be-3d7f-498b-823d-e1d5587099f9 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0796649
May 26 15:04:22.570527 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0b009638-ba2a-4557-839b-383a71587ec0 req-177194e6-1b1e-47fa-b3ac-d01046786e22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0434444
May 26 15:04:22.964645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 req-7a4a5577-4ba7-448d-886a-0c39bc7b7f59 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:22.966127 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 req-7a4a5577-4ba7-448d-886a-0c39bc7b7f59 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.0815096
May 26 15:04:23.010779 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 req-61a95094-712c-4a9c-b21e-ef4032335935 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390816
May 26 15:04:23.119478 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:23.194288 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0469f7e2-5e8a-4ede-b2f6-9a235b428613 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:23.314539 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911a22e7-2516-4990-9fba-9ed3466757e4 req-bf39b770-82bb-4432-94a2-a8ba6b23084d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.315989 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-911a22e7-2516-4990-9fba-9ed3466757e4 req-bf39b770-82bb-4432-94a2-a8ba6b23084d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.2191176
May 26 15:04:23.317841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-6394900a-bd9c-4a04-88da-e50bf93a4f7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.319130 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-6394900a-bd9c-4a04-88da-e50bf93a4f7b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe&tenant_id=7555f6895a2a405685d8ccfe81fe5a74 HTTP/1.1" status: 200  len: 1096 time: 0.1103916
May 26 15:04:23.398676 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-911a22e7-2516-4990-9fba-9ed3466757e4 req-2cb45c28-45f9-4dcf-b0d8-00598825dd58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0765102
May 26 15:04:23.429044 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-59d2b23a-49ac-4dfd-9908-d2a0c3a20e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.430627 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-59d2b23a-49ac-4dfd-9908-d2a0c3a20e7c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1096 time: 0.0803030
May 26 15:04:23.569749 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-813bcc92-2e00-4597-bdda-47656c0605f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.571206 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-813bcc92-2e00-4597-bdda-47656c0605f5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 200  len: 919 time: 0.1281557
May 26 15:04:23.615700 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3c58aec-69db-471f-8f97-df13f95877d4 req-cba0d922-ac63-4d9b-932b-2442898f4024 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.617395 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b3c58aec-69db-471f-8f97-df13f95877d4 req-cba0d922-ac63-4d9b-932b-2442898f4024 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0882435
May 26 15:04:23.681019 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-d4d0ba1b-09d4-471b-8473-40e21e918ded service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 200  len: 999 time: 0.1024342
May 26 15:04:23.715343 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b3c58aec-69db-471f-8f97-df13f95877d4 req-6c0ae97e-e324-41bb-9033-5757b6e910a9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0921285
May 26 15:04:23.744898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-e36fd1b3-b1e2-47f8-b6ab-5eeeaef76c04 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.746393 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-e36fd1b3-b1e2-47f8-b6ab-5eeeaef76c04 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.1070259
May 26 15:04:23.800421 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-adc16397-9517-4720-8a7e-65d1fbcff125 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.801891 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-adc16397-9517-4720-8a7e-65d1fbcff125 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 200  len: 856 time: 0.0813975
May 26 15:04:23.861404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 req-23839989-9d24-46ac-9e41-d3d263239e14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.862879 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 req-23839989-9d24-46ac-9e41-d3d263239e14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.1804607
May 26 15:04:23.886068 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Deleting port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:23.886413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:23.922919 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 req-f7f6eec6-8f2d-490b-a26f-25b7732ebfdd tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0527103
May 26 15:04:23.931765 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-6b2dc786-85bb-43ce-9886-07d7eafad172 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:23.933122 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-6b2dc786-85bb-43ce-9886-07d7eafad172 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c010dc4d-023b-4979-a482-d3b3e0924e91&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1239915
May 26 15:04:24.021917 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] For port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:24.022284 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:24.048139 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:24.073309 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-8b4f9ba3-5cac-4f6d-866b-91565da14c4f service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1322198
May 26 15:04:24.217264 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-88566151-71d6-4cc5-bbf4-95c2e1897a9f service neutron] 10.222.0.32 "GET /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1357994
May 26 15:04:24.377732 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07212260-ae9e-4e6b-a7a4-9372b080c1aa req-0e50d288-a15a-4cec-aacf-376dd45f1420 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:24.379296 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07212260-ae9e-4e6b-a7a4-9372b080c1aa req-0e50d288-a15a-4cec-aacf-376dd45f1420 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 943 time: 0.1925576
May 26 15:04:24.522663 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-07212260-ae9e-4e6b-a7a4-9372b080c1aa req-b9cf5da3-5848-4643-aff0-09bc3ace669e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0824740
May 26 15:04:24.528953 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:24.530651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:24.531407 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Floating IP 5cbf2dfd-9afc-42d6-a2b6-9868818661fb disassociated. External IP: 172.27.2.230, port: 5bd02faf-9eb5-4f97-86fd-6985a1bd6902.
May 26 15:04:24.532297 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling delete_port for 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 owned by compute:nova {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:24.594264 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 req-13e5854b-923d-4c14-ac89-95ad389fa217 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:24.594264 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 req-13e5854b-923d-4c14-ac89-95ad389fa217 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 946 time: 0.0881042
May 26 15:04:24.640375 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 req-aec27539-d65d-4b54-a1f9-f83cf1062113 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups?id=9f4f2011-11f2-4842-b93a-4f7e6c181dfc&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393515
May 26 15:04:24.707902 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:24.713661 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-14a5c5b6-8982-41e6-92e0-37c12b36276a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:24.760344 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'Port': ['ID=5bd02faf-9eb5-4f97-86fd-6985a1bd6902,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:24.763469 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:25.024461 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:04:25.172135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-814d4d85-0cc5-49df-b8b2-1ab75673df14 req-d59f4ac1-32d4-4273-8285-6c3b92885924 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:25.174376 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-814d4d85-0cc5-49df-b8b2-1ab75673df14 req-d59f4ac1-32d4-4273-8285-6c3b92885924 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.1200876
May 26 15:04:25.196231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:04:25.231820 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:25.247509 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '24388d3c-fd02-41f5-996a-da7452902c2b', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'port_id': '24388d3c-fd02-41f5-996a-da7452902c2b', 'mac_address': 'fa:16:3e:cc:eb:6d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1218, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:04:25.266555 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-814d4d85-0cc5-49df-b8b2-1ab75673df14 req-57bc5801-3688-4757-b83a-ec93ea546417 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0842044
May 26 15:04:25.322265 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:25.348099 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 24388d3c-fd02-41f5-996a-da7452902c2b {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:04:25.370377 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:25.380949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee0a1257-e76e-49db-a44b-9268fdbd4192 req-2bc42b9f-0847-416f-840a-1ec98ba9b700 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:25.382505 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ee0a1257-e76e-49db-a44b-9268fdbd4192 req-2bc42b9f-0847-416f-840a-1ec98ba9b700 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.3129213
May 26 15:04:25.434458 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:25.436482 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:25.532947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=7']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:25.539999 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:25.560810 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ee0a1257-e76e-49db-a44b-9268fdbd4192 req-fb63afd7-dfed-4f45-bcc8-07949fd7e2ae tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1047816
May 26 15:04:25.561939 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:04:25.575185 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:04:25.603464 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:25.608262 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:04:25.608887 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac42ec5b0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:25.680311 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['24388d3c-fd02-41f5-996a-da7452902c2b'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:04:25.758395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-858fee53-8994-46c9-87ab-9502a9faca89 req-1f31adce-2139-4014-a3d9-09598df79a18 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:25.761065 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-858fee53-8994-46c9-87ab-9502a9faca89 req-1f31adce-2139-4014-a3d9-09598df79a18 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.1050458
May 26 15:04:25.821475 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 req-baad164c-63d8-4f1c-a746-d456e3a55e9c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0582960
May 26 15:04:25.845369 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-858fee53-8994-46c9-87ab-9502a9faca89 req-57d0f135-3310-42f7-8410-d5c2b46fec24 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0775836
May 26 15:04:25.927614 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:04:26.136070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] No DVR routers for this DVR port 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 on host hv-cinder-78414 {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:04:26.138745 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:26.141916 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'name': 'network-vif-deleted', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:26.153961 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.32 "DELETE /v2.0/ports/5bd02faf-9eb5-4f97-86fd-6985a1bd6902 HTTP/1.1" status: 204  len: 173 time: 2.4018078
May 26 15:04:26.187359 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7ad07221-7c50-403d-9d99-8f876d7b7c63', 'name': 'network-vif-deleted', 'tag': '5bd02faf-9eb5-4f97-86fd-6985a1bd6902', 'status': 'completed', 'code': 200}
May 26 15:04:26.467697 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac42ec5b0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:26.474724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:04:26.487170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:04:26.487943 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac42ec5b0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:26.534539 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e483811-1386-4e2d-b101-a8464cfbc054 req-10821077-b17d-4440-a668-57e151a697ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:26.536239 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7e483811-1386-4e2d-b101-a8464cfbc054 req-10821077-b17d-4440-a668-57e151a697ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.1416023
May 26 15:04:26.596085 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7e483811-1386-4e2d-b101-a8464cfbc054 req-3190f724-f5da-4c1f-b40b-5848faf18fb3 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0433972
May 26 15:04:26.678231 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:04:26.815165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-516febed-6e02-4dfb-b0f2-1143bae5874c req-9712672e-d3d0-4fe9-936f-a9bb1cac0954 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:26.816598 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-516febed-6e02-4dfb-b0f2-1143bae5874c req-9712672e-d3d0-4fe9-936f-a9bb1cac0954 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0917633
May 26 15:04:26.862280 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-516febed-6e02-4dfb-b0f2-1143bae5874c req-506be696-d051-4e58-ac65-3391c6f1bb5f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0397117
May 26 15:04:26.979865 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6cf11471-b02c-4d27-a25f-d8547da01290 req-3bda6187-8885-422b-a5c9-111ba2602fdb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0446382
May 26 15:04:27.017314 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac42ec5b0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:27.021358 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d27d98ed-0be8-4175-b57d-d069e299d70e None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T14:57:44Z', 'revision_number': 4, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '56817f6f-822d-4a68-9672-25adff526515', 'name': '', 'network_id': '9a6b2b45-d448-425b-9716-75ffabad6539', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'mac_address': 'fa:16:3e:55:36:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_interface', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:41Z', 'updated_at': '2021-05-26T14:57:57Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'subnets': [{'id': '455a1c06-d094-4995-9b7a-561be9ec484c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:04:27.026294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:04:27.060701 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e2b75e3-ef5e-444a-8848-47e7903a1579 req-98d70a6a-03a8-4901-a71f-7852ece4c92b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:27.062384 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9e2b75e3-ef5e-444a-8848-47e7903a1579 req-98d70a6a-03a8-4901-a71f-7852ece4c92b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 944 time: 0.0852785
May 26 15:04:27.120527 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 24388d3c-fd02-41f5-996a-da7452902c2b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:04:27.120966 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:27.122189 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9e2b75e3-ef5e-444a-8848-47e7903a1579 req-36ab0a7a-d6c2-458f-b4d7-a6b1262911c3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0529697
May 26 15:04:27.257701 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:27.285284 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:27.295726 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:27.309626 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8337f7da-2895-42db-bf14-ad05240e653a None None] New status for floating IP 5cbf2dfd-9afc-42d6-a2b6-9868818661fb: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:04:27.329796 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'code': 200}
May 26 15:04:27.354078 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:27.354873 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:27.390095 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:27.437230 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:04:27.438122 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 5bd02faf-9eb5-4f97-86fd-6985a1bd6902 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:04:27.470415 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=8']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:27.478026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:27.783432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f5be131-0bca-4917-a851-c33ebbc0f7ce req-370cfc1b-e790-47dd-89d3-3b7718f6ad40 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:27.784877 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1f5be131-0bca-4917-a851-c33ebbc0f7ce req-370cfc1b-e790-47dd-89d3-3b7718f6ad40 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0830405
May 26 15:04:27.833767 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1f5be131-0bca-4917-a851-c33ebbc0f7ce req-20120f36-86a0-41a5-933b-9a534e895b9c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0428777
May 26 15:04:28.135484 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae req-6703add9-12d6-4c52-b400-76d0dbae9a18 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Synchronizing usage tracker for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:04:28.207972 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f309d803-c889-4e82-b347-21f8f265b163 req-11dd30e3-33e2-40ae-808f-05e6cb8162d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:28.210345 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f309d803-c889-4e82-b347-21f8f265b163 req-11dd30e3-33e2-40ae-808f-05e6cb8162d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0894029
May 26 15:04:28.216980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae req-6703add9-12d6-4c52-b400-76d0dbae9a18 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Unset dirty status for tenant:81e8cac36a174b2eb5a6e53fdf25b4cc on resource:port {{(pid=103981) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:04:28.218379 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae req-6703add9-12d6-4c52-b400-76d0dbae9a18 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.1259816
May 26 15:04:28.276457 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f309d803-c889-4e82-b347-21f8f265b163 req-4c80e600-8952-4fa1-8937-7c04a7ee8974 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0600934
May 26 15:04:28.551220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-323552eb-f3af-4d00-b518-bab7661f5d1b req-6c948557-6bc6-4b5d-9180-17149dcb7a28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:28.552697 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-323552eb-f3af-4d00-b518-bab7661f5d1b req-6c948557-6bc6-4b5d-9180-17149dcb7a28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.2025077
May 26 15:04:28.597481 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-323552eb-f3af-4d00-b518-bab7661f5d1b req-35a5ce6f-b3ae-425d-b712-ce0199ae5c88 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0391698
May 26 15:04:29.018802 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f72b42-c64a-457a-a98f-e462145afaed req-1a904a9a-bca1-499e-97cb-eaa9c105f9de tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:29.020254 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-47f72b42-c64a-457a-a98f-e462145afaed req-1a904a9a-bca1-499e-97cb-eaa9c105f9de tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0799353
May 26 15:04:29.068105 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-47f72b42-c64a-457a-a98f-e462145afaed req-9292e154-0f22-4326-bee9-e544535ec820 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0417447
May 26 15:04:29.407695 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-dc3643c6-fada-40ec-8d8f-18c46530e3cd req-24081b7a-e0f2-4b78-a665-547ce24359f0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0575380
May 26 15:04:29.433733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:29.625975 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9851ee7-fd86-4652-95c9-341ae2832ff0 req-ff7ac8ce-b356-49d4-9ef7-6bddac51c74d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:29.627461 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d9851ee7-fd86-4652-95c9-341ae2832ff0 req-ff7ac8ce-b356-49d4-9ef7-6bddac51c74d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.1809034
May 26 15:04:29.674303 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d9851ee7-fd86-4652-95c9-341ae2832ff0 req-ce180877-2850-477e-9cea-3c964c5fd192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0409362
May 26 15:04:29.805254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c61b82-47ce-473b-bd65-520f12ef3b4c req-a0349055-807c-41ec-aa0a-ebb0b63d08a2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:29.806971 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e6c61b82-47ce-473b-bd65-520f12ef3b4c req-a0349055-807c-41ec-aa0a-ebb0b63d08a2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1047838
May 26 15:04:29.864551 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e6c61b82-47ce-473b-bd65-520f12ef3b4c req-f9e63c26-216f-4d43-b67d-0e1f71a41dfc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0516160
May 26 15:04:30.311438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965aecc8-a225-4b13-b2ca-6c61625c29b6 req-dc0b1d75-fa19-4f8d-9d45-80f33508a2a7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:30.313396 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-965aecc8-a225-4b13-b2ca-6c61625c29b6 req-dc0b1d75-fa19-4f8d-9d45-80f33508a2a7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0883882
May 26 15:04:30.362080 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-965aecc8-a225-4b13-b2ca-6c61625c29b6 req-4e7586b5-82b4-4cd1-aded-f42d08e0c791 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0432088
May 26 15:04:30.577022 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 req-c6e39056-ea6b-415e-9b4a-2371262b4d79 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0479345
May 26 15:04:30.879109 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-229e82f7-6f89-4e94-ac77-46f189d332f8 req-d40f608a-a335-4821-baf9-aa8c6a38e962 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:30.880565 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-229e82f7-6f89-4e94-ac77-46f189d332f8 req-d40f608a-a335-4821-baf9-aa8c6a38e962 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0877223
May 26 15:04:30.925590 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-229e82f7-6f89-4e94-ac77-46f189d332f8 req-daebdd10-8047-4775-83cd-230eb52cf8bf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0392432
May 26 15:04:31.057005 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 req-66151ba8-1046-481f-9411-306e6bd51ca3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:31.058470 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 req-66151ba8-1046-481f-9411-306e6bd51ca3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0884404
May 26 15:04:31.106321 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 req-a34270ae-122d-41f2-b6cf-878651328a69 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410457
May 26 15:04:31.552390 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 req-32434a80-f975-453c-9cba-5d75fcbda239 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:31.553861 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 req-32434a80-f975-453c-9cba-5d75fcbda239 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0840030
May 26 15:04:31.599773 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 req-5174ee3a-bba9-487d-9ad3-fd3511a204c4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0402770
May 26 15:04:31.735116 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-275ba770-f2c4-4276-8157-ca940402b266 req-f7c92bfd-ee65-4bd1-ab85-64da363b298b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0512531
May 26 15:04:32.148395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 req-79e1f1da-e20e-4584-ad96-286c03b73a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:32.149928 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 req-79e1f1da-e20e-4584-ad96-286c03b73a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0884259
May 26 15:04:32.207015 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 req-663e70fb-1d7d-4213-ae11-f2a6ffeb8e55 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0514958
May 26 15:04:32.311264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5e47309-323e-489c-b706-7683f1085cdb req-20641d6d-3122-400a-a203-d3bb4f61b4ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:32.313422 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b5e47309-323e-489c-b706-7683f1085cdb req-20641d6d-3122-400a-a203-d3bb4f61b4ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0879614
May 26 15:04:32.366164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b5e47309-323e-489c-b706-7683f1085cdb req-782746b5-5af7-4984-9651-eddc8ce3b78f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0455801
May 26 15:04:32.784440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ab516c-3d04-4c0b-bb68-289554003f60 req-3173ad32-d222-485f-a47c-4f852b350b27 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:32.786069 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-81ab516c-3d04-4c0b-bb68-289554003f60 req-3173ad32-d222-485f-a47c-4f852b350b27 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0809562
May 26 15:04:32.834500 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-81ab516c-3d04-4c0b-bb68-289554003f60 req-2036fac1-de37-4786-ba60-b0bdf2c9fce9 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0427454
May 26 15:04:32.890409 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f41a65e1-c031-411d-9001-23d074490c0b req-eedc2f8d-1ae1-40d0-be60-7714b1169fce tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0488825
May 26 15:04:33.409309 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 req-bf30ed36-fa86-460c-80a4-a2ed346ad60b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:33.410849 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 req-bf30ed36-fa86-460c-80a4-a2ed346ad60b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0851059
May 26 15:04:33.455980 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 req-7f878301-b157-41cf-bba5-a45727f79805 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0393426
May 26 15:04:33.562932 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ac390d-e8d0-4d65-ace8-2568c6143977 req-1796d733-fb1a-4a4b-b3b5-cc17284cbbad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:33.564493 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e7ac390d-e8d0-4d65-ace8-2568c6143977 req-1796d733-fb1a-4a4b-b3b5-cc17284cbbad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0887320
May 26 15:04:33.613702 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e7ac390d-e8d0-4d65-ace8-2568c6143977 req-0c991ac2-b416-49a5-a999-289303c296fc tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435035
May 26 15:04:34.047026 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 req-b90a4cbe-96fd-434e-90d1-18137cc30c5a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:34.049882 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 req-b90a4cbe-96fd-434e-90d1-18137cc30c5a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0985720
May 26 15:04:34.054249 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-424a3011-b140-48f5-a92c-13c5c9b71c56 req-0e04f559-4669-4e3a-b9b5-78c7757dbcac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0541735
May 26 15:04:34.108964 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 req-15df8eab-d306-45aa-8f22-a4ba4223f9b8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0525851
May 26 15:04:34.662586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4469a07-4376-45d4-b6de-8f898d60caea req-4cdaeba5-b896-4d51-a97e-93aeaf9ef382 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:34.718109 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f4469a07-4376-45d4-b6de-8f898d60caea req-4cdaeba5-b896-4d51-a97e-93aeaf9ef382 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0902061
May 26 15:04:34.718109 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f4469a07-4376-45d4-b6de-8f898d60caea req-2c8ec696-c580-49aa-8a41-1be8e12fe70b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390294
May 26 15:04:34.827534 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-503ac153-9fda-4029-8fdd-a4c875d06315 req-1bcb16f6-b534-4937-a77f-d21609a51916 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:34.829973 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-503ac153-9fda-4029-8fdd-a4c875d06315 req-1bcb16f6-b534-4937-a77f-d21609a51916 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0859978
May 26 15:04:34.879605 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-503ac153-9fda-4029-8fdd-a4c875d06315 req-50cdc2bd-c46d-44df-b53a-5c4c3bd98f4f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440023
May 26 15:04:35.204814 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0e54bc36-32e0-4535-b213-f3171e05c4ad req-b08ba66b-c1ff-4637-adeb-30d21a69a365 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0442510
May 26 15:04:35.301889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 req-d80d4f26-9873-476d-8665-6dfe2024f507 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:35.303374 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 req-d80d4f26-9873-476d-8665-6dfe2024f507 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0951543
May 26 15:04:35.357710 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 req-c2f9eecb-d733-4120-97e3-54fc7b7ed834 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0471461
May 26 15:04:35.993199 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e req-074a8440-9a1f-441a-b3e3-575d12b4a281 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:35.993199 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e req-074a8440-9a1f-441a-b3e3-575d12b4a281 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0938818
May 26 15:04:35.993199 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e req-741e0bd3-b16c-4462-bf96-c1bcb0808090 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475559
May 26 15:04:36.130383 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97cd15f8-6118-4a3f-b59c-9e211115494c req-1d05e4cd-29c7-4519-92b1-a165a16abb74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:36.131931 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-97cd15f8-6118-4a3f-b59c-9e211115494c req-1d05e4cd-29c7-4519-92b1-a165a16abb74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0940907
May 26 15:04:36.201430 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-97cd15f8-6118-4a3f-b59c-9e211115494c req-72ddbc4e-25f3-4d72-bcb1-34ea41bc23b3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0632946
May 26 15:04:36.360548 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 req-1688b823-493f-4f34-b324-36bb371faaca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0429413
May 26 15:04:36.546376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccfa57f2-69ca-4443-814d-fd4c92cf900c req-acf9dbd8-7a52-4e83-bd8b-d01a8d3b14d6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:36.548092 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ccfa57f2-69ca-4443-814d-fd4c92cf900c req-acf9dbd8-7a52-4e83-bd8b-d01a8d3b14d6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0824187
May 26 15:04:36.599310 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ccfa57f2-69ca-4443-814d-fd4c92cf900c req-20ebba61-bc69-433a-8cae-8f9d6514c5ee tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0452535
May 26 15:04:37.190537 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf req-5f7a1a40-8df2-4289-9e27-547a9d35f8dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:37.191923 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf req-5f7a1a40-8df2-4289-9e27-547a9d35f8dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0923963
May 26 15:04:37.243726 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf req-ca8f1b3a-6531-408e-a5c7-32868ea97485 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462189
May 26 15:04:37.394637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95e868f1-0caa-4543-988f-9c6f910e1dda req-be241db0-ffd4-4759-a4bc-3ffaecb0a639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:37.396154 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95e868f1-0caa-4543-988f-9c6f910e1dda req-be241db0-ffd4-4759-a4bc-3ffaecb0a639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0928147
May 26 15:04:37.461651 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95e868f1-0caa-4543-988f-9c6f910e1dda req-62f79c06-7bde-4583-8cb9-e981d486eae3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413127
May 26 15:04:37.522182 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b req-439d7154-c884-4f4d-af58-5f42c7503e52 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0477211
May 26 15:04:37.800611 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcfe1ec2-c238-40d8-bbc9-40851d898096 req-1b1208c1-c3e7-46ad-90f9-ef773b84899f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:37.802115 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dcfe1ec2-c238-40d8-bbc9-40851d898096 req-1b1208c1-c3e7-46ad-90f9-ef773b84899f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0897312
May 26 15:04:37.852551 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-dcfe1ec2-c238-40d8-bbc9-40851d898096 req-3c0d35ec-5c50-4510-80cd-d3ec678e6131 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0435526
May 26 15:04:38.431162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 req-8bab33a5-c248-44c1-acb3-71a793386905 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:38.432606 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 req-8bab33a5-c248-44c1-acb3-71a793386905 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0796576
May 26 15:04:38.477283 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 req-80a4c056-68bd-4b7c-9a11-7dc9b92e7158 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0390742
May 26 15:04:38.631280 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046e0849-a1e2-4c49-ad1b-8fa675da20ad req-b8a353f8-1907-4c2b-bd50-54103e7c3fa5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:38.632752 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-046e0849-a1e2-4c49-ad1b-8fa675da20ad req-b8a353f8-1907-4c2b-bd50-54103e7c3fa5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0810957
May 26 15:04:38.678317 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-046e0849-a1e2-4c49-ad1b-8fa675da20ad req-cb64416c-b290-486a-b0f5-91dc0ecca539 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0400186
May 26 15:04:38.678957 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-f05d020b-38b1-4aca-8a7e-d9824878b7eb req-3f393214-66a4-4074-a84f-71243556da8e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/ports?device_id=7ad07221-7c50-403d-9d99-8f876d7b7c63 HTTP/1.1" status: 200  len: 210 time: 0.0459757
May 26 15:04:39.055575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722c628e-29e4-412e-8628-0a5fb3fc338f req-a4508102-3ebb-4143-9616-ee1428755089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:39.057071 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-722c628e-29e4-412e-8628-0a5fb3fc338f req-a4508102-3ebb-4143-9616-ee1428755089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0909359
May 26 15:04:39.118808 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-722c628e-29e4-412e-8628-0a5fb3fc338f req-e4e9fe1c-1b51-4f8b-91b9-a5c5e3b00ce4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0472004
May 26 15:04:39.143743 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1b5824-0c84-4d42-827f-ffa7f733bb7d req-f8c1d70c-01b3-4dd3-b6c0-bef99b4cb2a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:39.145173 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db1b5824-0c84-4d42-827f-ffa7f733bb7d req-f8c1d70c-01b3-4dd3-b6c0-bef99b4cb2a0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0959964
May 26 15:04:39.198508 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-db1b5824-0c84-4d42-827f-ffa7f733bb7d req-95322cfb-40fd-4a66-83f0-95e46298e68e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457785
May 26 15:04:39.695752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 req-c1b202e9-e6c7-401e-a30d-a030b2ed9088 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:39.697450 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 req-c1b202e9-e6c7-401e-a30d-a030b2ed9088 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0881343
May 26 15:04:39.743614 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 req-d83ea6f1-6ce5-4e4e-b3fb-2596286e9f2a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0395684
May 26 15:04:39.880748 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 req-319e4da7-ab6f-4333-a750-f16cfcee4e8f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:39.882615 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 req-319e4da7-ab6f-4333-a750-f16cfcee4e8f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0931551
May 26 15:04:39.936690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 req-4ee5ec9d-e3d0-4602-b602-7e687806aaa8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0483041
May 26 15:04:40.115332 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34750) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:40.181006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.209632 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.325497 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b451a9-ab77-4640-bea5-98e0a1892669 req-f242ac2b-6379-49ac-a7d1-6dd747852652 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:40.327056 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62b451a9-ab77-4640-bea5-98e0a1892669 req-f242ac2b-6379-49ac-a7d1-6dd747852652 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0985875
May 26 15:04:40.374522 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-62b451a9-ab77-4640-bea5-98e0a1892669 req-408d4e9f-72c7-4cbb-a713-0af253d5761a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&id=26cf896a-b80b-402b-9c0b-61fd0465af2a&fields=id&fields=name HTTP/1.1" status: 200  len: 379 time: 0.0413098
May 26 15:04:40.381980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.387019 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fdd08d88-540c-4164-9fc9-2452b9d34e8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:40.401405 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f4f2011-11f2-4842-b93a-4f7e6c181dfc,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:40.409978 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.413566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.414515 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:04:40.416733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:40.470901 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.470901 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /v2.0/security-groups/9f4f2011-11f2-4842-b93a-4f7e6c181dfc HTTP/1.1" status: 204  len: 168 time: 0.3519490
May 26 15:04:40.471764 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34758) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:40.488460 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.api.v2.resource [None req-d042cb02-e2cc-49e4-b508-72d8baecc5ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] show failed (client error): The resource could not be found.
May 26 15:04:40.489413 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d042cb02-e2cc-49e4-b508-72d8baecc5ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /v2.0/security-groups/9f4f2011-11f2-4842-b93a-4f7e6c181dfc HTTP/1.1" status: 404  len: 347 time: 0.0165348
May 26 15:04:40.492115 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34762) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:40.794114 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Deleting port f9565832-6c56-40c9-b714-05a99b72fea3 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:40.794689 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.917097 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.917431 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:40.939492 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a949d376-b71a-4a19-81db-70b87e3e214f req-67e34290-ff84-4748-9c74-49449a64a199 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:40.940968 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a949d376-b71a-4a19-81db-70b87e3e214f req-67e34290-ff84-4748-9c74-49449a64a199 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 943 time: 0.0872262
May 26 15:04:40.988526 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a949d376-b71a-4a19-81db-70b87e3e214f req-42d19c49-2000-4180-9b16-13ea892281ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0419133
May 26 15:04:41.048043 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling delete_port for f9565832-6c56-40c9-b714-05a99b72fea3 owned by network:floatingip {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:41.090518 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:04:41.151763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91e5c73d-88d1-4b62-b99e-c7b963b48061 req-ae6b1eaf-fa6f-4fa5-b4c0-ca1b40783da2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:41.153277 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-91e5c73d-88d1-4b62-b99e-c7b963b48061 req-ae6b1eaf-fa6f-4fa5-b4c0-ca1b40783da2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1023197
May 26 15:04:41.239070 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:41.239632 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-91e5c73d-88d1-4b62-b99e-c7b963b48061 req-b1cb85ac-b768-4e9b-8d7b-431a4ce1d8e0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0769711
May 26 15:04:41.253216 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'port_id': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'mac_address': 'fa:16:3e:2d:8c:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1224, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:04:41.312385 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:41.329290 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:04:41.344911 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:41.364200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:41.368990 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:41.413293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Pushing event deleted for resources: {'Port': ['ID=f9565832-6c56-40c9-b714-05a99b72fea3,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:41.421074 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:41.423167 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:41.442534 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:41.489037 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=9']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:41.492354 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:41.508790 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks [] for floatingip, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:41.581578 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:41.582750 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-004622d0-9ce5-4dae-8930-54606b4926c9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /v2.0/floatingips/5cbf2dfd-9afc-42d6-a2b6-9868818661fb HTTP/1.1" status: 204  len: 168 time: 1.0898018
May 26 15:04:41.633387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['d9f82690-b757-4c6f-b288-d20d193f4031'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:04:42.185980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6fb3476-1741-4b9f-a143-438353d4359c req-0c0f97fa-dbf1-4348-be07-064490777a26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:42.187463 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a6fb3476-1741-4b9f-a143-438353d4359c req-0c0f97fa-dbf1-4348-be07-064490777a26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 944 time: 0.0866928
May 26 15:04:42.302519 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a6fb3476-1741-4b9f-a143-438353d4359c req-928af89d-ccde-4e14-9a1c-ce5b659360aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1093030
May 26 15:04:43.101604 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:04:43.169606 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port d9f82690-b757-4c6f-b288-d20d193f4031 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:04:43.169980 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:43.320441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:43.347322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:04:43.361803 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:43.396954 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'code': 200}
May 26 15:04:43.433065 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:43.436298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:43.498309 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68799f37-6e93-4b65-b968-87bd261ff305 req-bd89adcc-1f65-450e-b5a4-be8fe2431d85 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:43.500381 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68799f37-6e93-4b65-b968-87bd261ff305 req-bd89adcc-1f65-450e-b5a4-be8fe2431d85 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.0837762
May 26 15:04:43.503471 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=10']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:43.506598 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:43.552265 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-68799f37-6e93-4b65-b968-87bd261ff305 req-211891de-4187-432c-b31f-5c2ab4f24fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0456967
May 26 15:04:43.797770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877f7d5f-afdd-4dad-98ac-d049f8acdbb6 req-691209ac-09f2-464e-9523-db904db208c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:43.799211 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-877f7d5f-afdd-4dad-98ac-d049f8acdbb6 req-691209ac-09f2-464e-9523-db904db208c1 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 1099 time: 0.0700305
May 26 15:04:43.839564 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-877f7d5f-afdd-4dad-98ac-d049f8acdbb6 req-81efdc93-5744-4a41-a309-2a000955becc service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0337422
May 26 15:04:44.756884 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15016295-c875-4e6f-b338-277dc8600265 req-449612da-e867-49a8-bf76-85e7145d4802 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:44.758673 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-15016295-c875-4e6f-b338-277dc8600265 req-449612da-e867-49a8-bf76-85e7145d4802 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.0933108
May 26 15:04:44.822080 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-15016295-c875-4e6f-b338-277dc8600265 req-9a7ab305-d828-4cef-a130-e8a93e9e9465 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0570464
May 26 15:04:46.001972 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34842) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:46.023892 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368381f0-af60-4deb-b824-cb4ab174ac58 req-7f6f5168-6dd5-46cc-ba1e-c1e868c3a084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:46.025371 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-368381f0-af60-4deb-b824-cb4ab174ac58 req-7f6f5168-6dd5-46cc-ba1e-c1e868c3a084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.0918159
May 26 15:04:46.071187 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-368381f0-af60-4deb-b824-cb4ab174ac58 req-3a215f69-f0e1-40a2-bc5e-648e97239df6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0398309
May 26 15:04:46.287074 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:04:46.745933 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:47.151443 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Deleting port 56817f6f-822d-4a68-9672-25adff526515 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:47.152165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:47.264119 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f83bd4ca-64d7-476e-841f-9f60aef35876 req-5bbc9466-d31a-4a6c-9f97-28611d4144bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:04:47.266120 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f83bd4ca-64d7-476e-841f-9f60aef35876 req-5bbc9466-d31a-4a6c-9f97-28611d4144bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.0806007
May 26 15:04:47.275128 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] For port 56817f6f-822d-4a68-9672-25adff526515, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=56817f6f-822d-4a68-9672-25adff526515,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:47.275505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:47.311608 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f83bd4ca-64d7-476e-841f-9f60aef35876 req-ebdf3374-d053-4d15-9b29-0a0d5d256b04 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0394545
May 26 15:04:47.402220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Calling delete_port for 56817f6f-822d-4a68-9672-25adff526515 owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:47.759170 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:47.762785 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:47.810281 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Pushing event deleted for resources: {'Port': ['ID=56817f6f-822d-4a68-9672-25adff526515,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:47.813005 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:48.169657 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:48.518338 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Router 181d9a3e-c807-4252-8929-049fb54cabe7 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:04:48.696904 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:04:48.706293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Sync routers for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:04:48.709709 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] 10.222.0.81 "PUT /v2.0/routers/181d9a3e-c807-4252-8929-049fb54cabe7/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7067018
May 26 15:04:48.712193 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34852) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:48.715571 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:04:48.716181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46d3dc0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:48.888050 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:48.895318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:04:49.073097 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:49.184506 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46d3dc0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153'}], 'enable_snat': True}, 'gw_port_id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:04:47Z', 'revision_number': 5, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port': {'id': '804f1d22-3cc0-476b-b4d7-d0fc2826e88a', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:d3:24', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 77, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:49.188427 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Checking router: 181d9a3e-c807-4252-8929-049fb54cabe7 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:04:49.194305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Deleting port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:49.194822 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:49.196826 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Routers {'181d9a3e-c807-4252-8929-049fb54cabe7'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:04:49.197426 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46d3dc0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['181d9a3e-c807-4252-8929-049fb54cabe7'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:49.315395 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] For port 804f1d22-3cc0-476b-b4d7-d0fc2826e88a, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:49.315778 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:49.344583 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] Set router 181d9a3e-c807-4252-8929-049fb54cabe7 gateway port host: None {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:04:49.443026 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Calling delete_port for 804f1d22-3cc0-476b-b4d7-d0fc2826e88a owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:49.449871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46d3dc0>, [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:04:49Z', 'revision_number': 6, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:49.454172 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68a3529e-30c9-471b-b2ec-f05d0d70558a None None] The sync data for ids ['181d9a3e-c807-4252-8929-049fb54cabe7'] in dv-cinder-784140-4-iscsi is: [{'id': '181d9a3e-c807-4252-8929-049fb54cabe7', 'name': 'tempest-AttachVolumeTestJSON-330955373-router', 'tenant_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:33Z', 'updated_at': '2021-05-26T15:04:49Z', 'revision_number': 6, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'gw_port_host': None}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:04:49.748195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:49.751929 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b8126a89-779b-4dc6-ba10-8b6a85be0584 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:49.795453 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Pushing event deleted for resources: {'Port': ['ID=804f1d22-3cc0-476b-b4d7-d0fc2826e88a,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:49.800660 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:49.897013 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.068348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.070461 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.152342 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.152788 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 181d9a3e-c807-4252-8929-049fb54cabe7 {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:04:50.166333 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.167467 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fdb08d3c-5ad5-4423-a89f-90dadee956b5 admin admin] 10.222.0.81 "DELETE /v2.0/routers/181d9a3e-c807-4252-8929-049fb54cabe7 HTTP/1.1" status: 204  len: 168 time: 1.4543545
May 26 15:04:50.170111 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34856) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:50.230625 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Deleting subnet 455a1c06-d094-4995-9b7a-561be9ec484c {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:04:50.233648 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.287683 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.408184 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.524344 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-9aa54cf6-cb04-40dc-8366-b7e72d052c03 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.719993 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.723975 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:50.762137 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=455a1c06-d094-4995-9b7a-561be9ec484c,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:50.764571 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:50.768289 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.776457 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-38cb70f4-b64c-46e2-8466-7e466ac28077 None None] Network 9a6b2b45-d448-425b-9716-75ffabad6539 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:04:50.776595 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f59f8c5c-87f3-4238-a1c2-22e8983ffc96 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/455a1c06-d094-4995-9b7a-561be9ec484c HTTP/1.1" status: 204  len: 168 time: 0.6039729
May 26 15:04:50.777488 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34860) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:50.882941 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:50.954710 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Deleting port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:50.955154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.045872 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] DHCP port deletion for 9a6b2b45-d448-425b-9716-75ffabad6539 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:04:51.059159 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] For port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:51.059538 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.111421 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Deleting port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:04:51.111720 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.183836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Calling delete_port for 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:51.190618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 56817f6f-822d-4a68-9672-25adff526515 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:51.228687 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 56817f6f-822d-4a68-9672-25adff526515 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:04:51.229030 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 56817f6f-822d-4a68-9672-25adff526515 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:04:51.229453 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:51.285848 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.289784 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-70d2d140-c703-4f02-b3ba-d5ebddc0ac73 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:51.303821 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:04:51.304173 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:04:51.304618 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 804f1d22-3cc0-476b-b4d7-d0fc2826e88a no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:04:51.345351 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 804f1d22-3cc0-476b-b4d7-d0fc2826e88a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:04:51.345728 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 804f1d22-3cc0-476b-b4d7-d0fc2826e88a not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:04:51.348195 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] For port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,segment=NetworkSegment(5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6),segment_id=5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:04:51.348627 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.429980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Pushing event deleted for resources: {'Port': ['ID=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:51.431763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] No DVR routers for this DVR port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:04:51.433205 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:51.472716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Calling delete_port for 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:04:51.551348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.564478 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4cae820>,) {'filters': {'network_id': ['9a6b2b45-d448-425b-9716-75ffabad6539']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:51.576268 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4cae820>, '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:51.576564 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4cae820>, '5e0bc1a7-d5fb-4381-aa56-93bbe8c5a1a6') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:04:51.588674 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.598239 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.602685 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-3450e73f-79eb-4e31-a030-8438a14d8661 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:51.605140 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.613857 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Releasing vlan 1230 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:04:51.614361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:04:51.627783 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:04:51.652283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Pushing event deleted for resources: {'Port': ['ID=8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:51.654433 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] No DVR routers for this DVR port 8c2f3dd8-5bac-40e2-bb14-2cdf7b1d5d16 on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:04:51.656139 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:51.787912 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.791473 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:51.804151 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:51.815814 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Pushing event deleted for resources: {'Network': ['ID=9a6b2b45-d448-425b-9716-75ffabad6539,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:51.822185 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:51.902720 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3f5cabde-3acf-4426-a658-9d259ee38f6c admin admin] 10.222.0.81 "DELETE /v2.0/networks/9a6b2b45-d448-425b-9716-75ffabad6539 HTTP/1.1" status: 204  len: 168 time: 1.1242590
May 26 15:04:52.176699 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34866) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:52.226573 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b6c931a5-2ac6-4f25-9664-c9cc9d12c890 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=81e8cac36a174b2eb5a6e53fdf25b4cc&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0482559
May 26 15:04:52.228934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 34870) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:04:52.288349 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:52.315021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:52.420809 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:52.425223 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9d5155ac-7129-40db-ae66-8ddcef4fad25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:04:52.442405 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56d52ae5-5589-46d2-aea6-10a220f07bf7,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:04:52.446198 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:04:52.449380 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:52.450504 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/56d52ae5-5589-46d2-aea6-10a220f07bf7 HTTP/1.1" status: 204  len: 168 time: 0.2206976
May 26 15:04:53.102012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:53.176778 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c53034d4-dda9-4cfb-86ec-bbb1d1930f83 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:54.079401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:55.643572 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:04:59.415600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:01.166903 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-aaa9009b-472d-4ae5-b8e8-f806d8b7c722 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0702538
May 26 15:05:01.310144 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-659c3d14-9017-4d79-865d-d55d0022d7be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:01.311758 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-659c3d14-9017-4d79-865d-d55d0022d7be service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0723357
May 26 15:05:01.460598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-524cf249-d924-4ed6-9cea-c8f23a5f53a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:01.462066 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-524cf249-d924-4ed6-9cea-c8f23a5f53a7 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.1288042
May 26 15:05:01.569081 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5896f21d-4a6a-4cf8-8dcc-ce3112943d4d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 1000 time: 0.0965784
May 26 15:05:01.635097 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5946d3b5-0f5d-4151-be4c-851e153ba09d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:01.636497 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5946d3b5-0f5d-4151-be4c-851e153ba09d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0603735
May 26 15:05:01.712291 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5f39e6ce-e53e-4038-a64c-f524a2922472 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:01.713761 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5f39e6ce-e53e-4038-a64c-f524a2922472 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0701113
May 26 15:05:01.853834 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-e6d3395a-5cc8-42e0-80fb-07f55d30a1f6 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1265457
May 26 15:05:01.992191 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-0a7ed463-7b81-4223-bdd7-9dfccfc5cb84 req-5a5b6145-f0a2-4514-8606-40d768237a0e service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1239550
May 26 15:05:14.546485 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35094) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:14.661476 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:14.676027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:14.679812 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Usage tracker for resource:security_group_rule and tenant:2e8ae3feb3274feeb2c7924cb83b93e3 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:14.682782 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:14.688632 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:14.767305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:14.838793 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:14.848829 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5a9a18df-0fe6-4149-949c-7db9e3d40d54 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:14.891767 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2e8ae3feb3274feeb2c7924cb83b93e3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3442187
May 26 15:05:14.893911 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c85012f-aad9-4403-9a18-8239e354b7e1,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:14.895235 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35102) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:14.897121 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:14.954066 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:14.983562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.124907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.128954 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-87a3830a-902a-4802-b94a-8a40b2bbbd6a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:15.139705 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c85012f-aad9-4403-9a18-8239e354b7e1,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:15.151156 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.151472 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.151840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.152201 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.152559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.152915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.153267 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.153646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.153999 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.154348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.154695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.155041 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:15.158097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.159817 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/2c85012f-aad9-4403-9a18-8239e354b7e1 HTTP/1.1" status: 204  len: 168 time: 0.2629709
May 26 15:05:15.160696 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-36c42879-6218-4d2f-afd3-ae4b965e1ce6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:15.698270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35110) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:15.716304 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.730641 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:15.734450 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Usage tracker for resource:security_group_rule and tenant:acd7728a0bf148a2902dad8ca9d114a6 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:15.737919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:15.743581 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:15.826418 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.896028 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:15.904878 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ade1aaac-3a1d-4d14-82ef-be7870295d8e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:15.943940 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=acd7728a0bf148a2902dad8ca9d114a6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2445719
May 26 15:05:15.945398 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=917ee9c4-c93e-43d8-a707-ba604771abcf,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:15.946599 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35114) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:15.948360 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:16.005431 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:16.030623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:16.157566 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:16.161810 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a73c83df-4993-42de-afd2-9d70ad0abe9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:16.173651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=917ee9c4-c93e-43d8-a707-ba604771abcf,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:16.176800 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:16.184615 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:16.185840 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-eb8d8f67-365e-445e-9402-a869d8414872 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/917ee9c4-c93e-43d8-a707-ba604771abcf HTTP/1.1" status: 204  len: 168 time: 0.2381852
May 26 15:05:19.060964 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-fcf0dedc-0ca1-4813-a288-60ab88106121 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-931696345&fields=id&tenant_id=83937b4f3831489289cd8aec97222f77 HTTP/1.1" status: 200  len: 267 time: 0.0387585
May 26 15:05:19.151246 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-0f7354e9-be97-4f39-9146-4e525fd618dc tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:19.152743 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-0f7354e9-be97-4f39-9146-4e525fd618dc tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 984 time: 0.0864968
May 26 15:05:19.163441 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Request body: {'port': {'security_groups': ['4c346a6a-0742-44bc-b430-b584c9e11507']}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:05:19.291876 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.623898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:19.649656 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.741725 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.747788 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:19.753381 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:05:19.816909 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:19.817881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.819287 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a87353f2-fe95-4f4c-a35b-e8702373480e req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "PUT /v2.0/ports/6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 942 time: 0.6605148
May 26 15:05:19.819816 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:05:19.825752 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35180) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:19.853791 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event updated for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=7']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:19.857925 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:19.878018 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:05:19.916992 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:05:19.924646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.960324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:19.986265 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-7e87713d-ea70-4702-93a7-c80c040fbb9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:19.988388 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-7e87713d-ea70-4702-93a7-c80c040fbb9d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1098 time: 0.0867858
May 26 15:05:20.112814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.117796 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-40129f6a-1632-49c2-bafc-bdd057f21230 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:20.134727 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=26cf896a-b80b-402b-9c0b-61fd0465af2a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:20.138213 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:20.149976 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-6d0cd1e2-5c36-4072-b806-df099726a843 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:20.151121 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-652498c2-a4ea-4416-9db0-ffed3550ad9b None None] Provisioning complete for port 6431ed44-bb34-4a76-bf6a-5f589562735a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:05:20.151456 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-6d0cd1e2-5c36-4072-b806-df099726a843 service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.1564267
May 26 15:05:20.151575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-652498c2-a4ea-4416-9db0-ffed3550ad9b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.210890 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.212301 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /v2.0/security-groups/26cf896a-b80b-402b-9c0b-61fd0465af2a HTTP/1.1" status: 204  len: 168 time: 0.3855348
May 26 15:05:20.228683 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35186) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:20.305133 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-70b6675e-fcb9-4569-926b-2f17dadd8ec8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 1001 time: 0.1462708
May 26 15:05:20.390972 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-aaa781dd-aa93-49ef-a901-ded1910f339f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:20.392612 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-aaa781dd-aa93-49ef-a901-ded1910f339f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0788119
May 26 15:05:20.493582 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-6b4ab01b-a04f-4aec-a6a8-e3c343357288 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:20.519388 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-6b4ab01b-a04f-4aec-a6a8-e3c343357288 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1164258
May 26 15:05:20.553889 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7c5f47cd-3e42-4331-ac7f-08fd12dde72d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.600162 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Deleting port e8457293-7703-41b8-8930-7052ec2a9bcd {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:20.600506 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.670495 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-469e2100-1cab-43fe-a0fe-814e911e500c service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1442826
May 26 15:05:20.731243 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.731571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:20.819107 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-6853dae0-e296-4453-a516-1c9577d906c3 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1308758
May 26 15:05:20.869006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling delete_port for e8457293-7703-41b8-8930-7052ec2a9bcd owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:21.072329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a80f6d-b567-4655-949f-30729c173d76 req-5b919938-5b3b-4e9f-93c6-533f8d4bef9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:21.073802 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-40a80f6d-b567-4655-949f-30729c173d76 req-5b919938-5b3b-4e9f-93c6-533f8d4bef9f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.1037393
May 26 15:05:21.122964 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-40a80f6d-b567-4655-949f-30729c173d76 req-32a99611-d9da-4582-85a6-024f163f20d8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0434113
May 26 15:05:21.154483 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:21.158423 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e4e11575-56ab-4126-ad38-a89967eb8ca2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:21.203473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event deleted for resources: {'Port': ['ID=e8457293-7703-41b8-8930-7052ec2a9bcd,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:21.206626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:21.296714 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:21.297038 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Floating IP b36abae4-a361-45a8-8331-43ccb71c28cb disassociated (deleted). External IP: 172.27.2.216, port: 6431ed44-bb34-4a76-bf6a-5f589562735a.
May 26 15:05:21.722574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Router 5f218ea9-44ea-4266-9fc8-01161ec57870 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:05:21.900273 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:05:21.909366 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Sync routers for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:05:21.918904 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:21.919507 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac50e29d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:21.986338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:22.042425 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /v2.0/floatingips/b36abae4-a361-45a8-8331-43ccb71c28cb HTTP/1.1" status: 204  len: 168 time: 1.8227050
May 26 15:05:22.043305 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:05:22.091773 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:05:22.133431 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:22.256145 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-3e0ade9a-98f0-4638-9054-bb428807e913 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.258858 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-3e0ade9a-98f0-4638-9054-bb428807e913 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=83937b4f3831489289cd8aec97222f77&device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 1098 time: 0.1408558
May 26 15:05:22.491733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-4db3bd49-916f-40f3-82a4-7cdb65096dd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.498081 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-4db3bd49-916f-40f3-82a4-7cdb65096dd5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 200  len: 916 time: 0.2308285
May 26 15:05:22.605273 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-ccca4e51-b176-4d5c-9962-0366cff6ba95 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 200  len: 217 time: 0.0906429
May 26 15:05:22.623516 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac50e29d0>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:22.632418 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Checking router: 5f218ea9-44ea-4266-9fc8-01161ec57870 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:05:22.650438 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:22.651204 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac50e29d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:04:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:22.656134 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccfbb614-a579-42c4-b7a7-62f742e65af8 req-b3c054ef-b660-4a04-976c-7523a8e4e84b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.670499 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ccfbb614-a579-42c4-b7a7-62f742e65af8 req-b3c054ef-b660-4a04-976c-7523a8e4e84b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.3773570
May 26 15:05:22.684244 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-288abbf4-f633-4afc-9e52-c49351a152c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.685793 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-288abbf4-f633-4afc-9e52-c49351a152c1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 200  len: 853 time: 0.0796485
May 26 15:05:22.697430 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-5c98c1ff-69b6-4117-ac93-238113e9111d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.698894 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-5c98c1ff-69b6-4117-ac93-238113e9111d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 946 time: 0.2906680
May 26 15:05:22.774313 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-bed76805-856c-465e-8bc7-ba57482b6dcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:22.776177 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-bed76805-856c-465e-8bc7-ba57482b6dcd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=91d594ee-93aa-497d-af26-3f3353865830&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0836332
May 26 15:05:22.786208 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ccfbb614-a579-42c4-b7a7-62f742e65af8 req-2e0f86f8-e641-4e27-bb78-fe5b22984438 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups?id=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1181688
May 26 15:05:22.843484 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:22.876512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Deleting port d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:22.876512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.041894 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-99810364-9b65-4663-bfa9-9b6c9f317fe1 service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2586818
May 26 15:05:23.101027 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] For port d9f82690-b757-4c6f-b288-d20d193f4031, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=d9f82690-b757-4c6f-b288-d20d193f4031,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:23.102147 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.148350 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.208411 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-1a53ec73-2361-425f-95ec-85b1a1a7e87b service neutron] 10.222.0.32 "GET /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1598349
May 26 15:05:23.222369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4515a4d2-1a37-4f62-879d-61b558b61b67 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.257676 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac50e29d0>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:23.261810 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a71c4d23-22e5-4eb8-9480-68e827f880cc None None] The sync data for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi is: [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:02:48Z', 'revision_number': 4, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'e1b444e0-d083-4f15-a3d0-2a82bf7344cc', 'name': '', 'network_id': '91d594ee-93aa-497d-af26-3f3353865830', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'mac_address': 'fa:16:3e:e1:13:ea', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_interface', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:47Z', 'updated_at': '2021-05-26T15:02:53Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'subnets': [{'id': '6bf4d059-576f-4ff2-9b19-4983cc253018', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:05:23.286235 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:05:23.446971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.447335 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.447641 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Floating IP 4614d2d8-5366-420f-9544-f7eeb2cf1a62 disassociated. External IP: 172.27.2.125, port: d9f82690-b757-4c6f-b288-d20d193f4031.
May 26 15:05:23.447972 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling delete_port for d9f82690-b757-4c6f-b288-d20d193f4031 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:23.498803 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e54dd451-58e8-43bc-a8dc-a758be57eb31 None None] New status for floating IP b36abae4-a361-45a8-8331-43ccb71c28cb: DOWN {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:05:23.662458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:23.672289 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-c6dff476-6071-4948-9f9c-89570f86f139 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:23.712514 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'Port': ['ID=d9f82690-b757-4c6f-b288-d20d193f4031,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:23.716183 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:23.942425 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-2d015801-114c-4264-b312-39936cc73e64 req-215ee91b-0e6d-490c-8397-4d1d247d069f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 210 time: 0.0425136
May 26 15:05:24.001279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:05:24.062460 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:24.200924 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:05:24.212601 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:05:24.227799 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:24.228543 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4c560a0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:24.279250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] No DVR routers for this DVR port d9f82690-b757-4c6f-b288-d20d193f4031 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:24.281780 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:24.284527 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-deleted', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:05:24.334163 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '757c7def-93df-481f-b40d-7115f4bbbefe', 'name': 'network-vif-deleted', 'tag': 'd9f82690-b757-4c6f-b288-d20d193f4031', 'status': 'completed', 'code': 200}
May 26 15:05:24.397228 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e req-f708ddcf-21d3-4508-afc4-b582ce19bb9b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.32 "DELETE /v2.0/ports/d9f82690-b757-4c6f-b288-d20d193f4031 HTTP/1.1" status: 204  len: 173 time: 1.6919849
May 26 15:05:24.440367 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:24.801494 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4c560a0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:24.805414 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:05:24.813644 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:24.814238 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4c560a0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:25.015732 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:25.083452 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35256) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:25.134848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 req-a07634fa-1937-4dc9-95b2-50ee2709ad2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Synchronizing usage tracker for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:05:25.253167 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 req-a07634fa-1937-4dc9-95b2-50ee2709ad2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Unset dirty status for tenant:7555f6895a2a405685d8ccfe81fe5a74 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:05:25.254849 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 req-a07634fa-1937-4dc9-95b2-50ee2709ad2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/ports?device_id=757c7def-93df-481f-b40d-7115f4bbbefe HTTP/1.1" status: 200  len: 210 time: 0.1729038
May 26 15:05:25.257737 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.275224 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:25.279263 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Usage tracker for resource:security_group_rule and tenant:ea86e64baf68471db9dee76506712857 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:25.283419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:25.288454 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:25.346429 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4c560a0>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:25.350540 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d96389e7-d084-48c9-8f09-9ec16644d58d None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T14:57:52Z', 'revision_number': 4, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '7d4cf06f-48f0-4f53-bdcb-f793e017b221', 'name': '', 'network_id': 'c010dc4d-023b-4979-a482-d3b3e0924e91', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'mac_address': 'fa:16:3e:02:17:fd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_interface', 'standard_attr_id': 110, 'fixed_ips': [{'subnet_id': '09a19960-7788-4d46-a08e-92c63f201983', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:47Z', 'updated_at': '2021-05-26T14:58:03Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'subnets': [{'id': '09a19960-7788-4d46-a08e-92c63f201983', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:05:25.376785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.381658 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:25.420785 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: d9f82690-b757-4c6f-b288-d20d193f4031 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:25.421159 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device d9f82690-b757-4c6f-b288-d20d193f4031 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:25.473763 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.482748 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41e4858b-3f17-40b1-be70-4d61b969e5e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:25.540296 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ea86e64baf68471db9dee76506712857&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4549639
May 26 15:05:25.542041 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05a78a30-4ea0-46bf-92b4-b189de88be02,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:25.543047 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35262) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:25.546629 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:25.594399 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4defa588-9f21-4054-b89d-0b8d71e37e3c None None] New status for floating IP 4614d2d8-5366-420f-9544-f7eeb2cf1a62: DOWN {{(pid=103983) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:05:25.619586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.648391 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.651362 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.769487 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.774768 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-66e33f18-6404-40e0-ab90-fc746a07b6b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:25.788777 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05a78a30-4ea0-46bf-92b4-b189de88be02,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:25.791572 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:25.794190 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:25.795480 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-677fc482-8bc7-4c8a-975e-56d6a0c1781d admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/05a78a30-4ea0-46bf-92b4-b189de88be02 HTTP/1.1" status: 204  len: 168 time: 0.2512746
May 26 15:05:26.491677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35280) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:26.535552 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35284) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:26.558884 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.562116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.577348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:26.583200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Usage tracker for resource:security_group_rule and tenant:d76447de55bd4d4f92d9f48e54bb608d is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:26.587186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:26.591894 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.594586 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:26.605296 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 req-ec4cfd45-4bdc-43d6-88bd-baece4824c29 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:26.606855 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 req-ec4cfd45-4bdc-43d6-88bd-baece4824c29 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.1291101
May 26 15:05:26.666460 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 req-1cbab165-e884-439b-8217-afa933f2c1dc tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0537903
May 26 15:05:26.707964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.714143 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a39d0cfb-d2a1-447a-b49d-9eb50ce21cbd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:26.730077 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:26.733284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:26.772073 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.800615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.801780 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /v2.0/security-groups/863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c HTTP/1.1" status: 204  len: 168 time: 0.3090892
May 26 15:05:26.805096 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35288) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:26.821925 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.api.v2.resource [None req-50fb81fb-f787-4841-b379-0dfd14bea0dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] show failed (client error): The resource could not be found.
May 26 15:05:26.822905 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-50fb81fb-f787-4841-b379-0dfd14bea0dd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /v2.0/security-groups/863a3f9b-9cf5-44a0-9bcf-61c1e8f06b4c HTTP/1.1" status: 404  len: 347 time: 0.0168247
May 26 15:05:26.826842 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.829006 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35292) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:26.829732 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c41abd4a-9b7a-4e03-b2d2-2cbd7c052a09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:26.873312 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d76447de55bd4d4f92d9f48e54bb608d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3365297
May 26 15:05:26.874320 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a17b1332-db46-44e7-8ed9-fa5c7ed04ee4,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:26.876544 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35296) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:26.878864 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-522af7c0-e376-4556-9ead-1ea3bc7cb3dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:26.936747 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:26.963448 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.048198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Deleting port 6f8c2a86-05f6-42d1-8c09-8a406f00d116 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:27.048537 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.078877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.083934 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-20c74566-9793-4c4d-8606-51dcb1cc640f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:27.099297 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a17b1332-db46-44e7-8ed9-fa5c7ed04ee4,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:27.102323 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:27.104195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.108401 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a17b1332-db46-44e7-8ed9-fa5c7ed04ee4 HTTP/1.1" status: 204  len: 168 time: 0.2278614
May 26 15:05:27.172361 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.172689 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.300278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling delete_port for 6f8c2a86-05f6-42d1-8c09-8a406f00d116 owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:27.467807 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.472639 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:27.519193 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Pushing event deleted for resources: {'Port': ['ID=6f8c2a86-05f6-42d1-8c09-8a406f00d116,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:27.522408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:27.612020 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.715387 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:27.716892 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /v2.0/floatingips/4614d2d8-5366-420f-9544-f7eeb2cf1a62 HTTP/1.1" status: 204  len: 168 time: 0.8868015
May 26 15:05:27.943744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0314286b-d80c-4028-a31d-504f794cedca req-1bd3ab70-26b0-4966-a2b2-7efac59bdac8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:27.947031 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0314286b-d80c-4028-a31d-504f794cedca req-1bd3ab70-26b0-4966-a2b2-7efac59bdac8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:05:28.033731 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0314286b-d80c-4028-a31d-504f794cedca req-1bd3ab70-26b0-4966-a2b2-7efac59bdac8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:05:28.034907 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0314286b-d80c-4028-a31d-504f794cedca req-1bd3ab70-26b0-4966-a2b2-7efac59bdac8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.2623937
May 26 15:05:28.080196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0314286b-d80c-4028-a31d-504f794cedca req-2e63129c-d3d1-4515-ae07-6e1771e99ca7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Synchronizing usage tracker for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:05:28.148292 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0314286b-d80c-4028-a31d-504f794cedca req-2e63129c-d3d1-4515-ae07-6e1771e99ca7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Unset dirty status for tenant:83937b4f3831489289cd8aec97222f77 on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:05:28.149429 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0314286b-d80c-4028-a31d-504f794cedca req-2e63129c-d3d1-4515-ae07-6e1771e99ca7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/security-groups?id=4c346a6a-0742-44bc-b430-b584c9e11507&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1087134
May 26 15:05:28.199547 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-c2b16bd1-408b-429e-bf27-a5dfb8da084f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:05:28.200987 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-c2b16bd1-408b-429e-bf27-a5dfb8da084f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.32 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 945 time: 0.0888855
May 26 15:05:28.341331 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Deleting port 6431ed44-bb34-4a76-bf6a-5f589562735a {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:28.341700 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:28.477831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] For port 6431ed44-bb34-4a76-bf6a-5f589562735a, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=6431ed44-bb34-4a76-bf6a-5f589562735a,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:28.478187 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:28.610350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling delete_port for 6431ed44-bb34-4a76-bf6a-5f589562735a owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:28.810943 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:28.816504 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:28.823271 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['6431ed44-bb34-4a76-bf6a-5f589562735a'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:05:28.870107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Pushing event deleted for resources: {'Port': ['ID=6431ed44-bb34-4a76-bf6a-5f589562735a,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:28.873410 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:28.945422 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] No DVR routers for this DVR port 6431ed44-bb34-4a76-bf6a-5f589562735a on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:28.947852 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:28.950501 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'name': 'network-vif-deleted', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:05:28.998467 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '40591370-dbd3-45b4-b6c6-a0e01a614c28', 'name': 'network-vif-deleted', 'tag': '6431ed44-bb34-4a76-bf6a-5f589562735a', 'status': 'completed', 'code': 200}
May 26 15:05:29.023165 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b8b642e5-f26b-430b-9754-f52aaafa0084 req-ac91ad19-ecb5-47e7-a491-e0e0c003db86 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.32 "DELETE /v2.0/ports/6431ed44-bb34-4a76-bf6a-5f589562735a HTTP/1.1" status: 204  len: 173 time: 0.8162756
May 26 15:05:29.334681 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 req-3a801534-e034-4c80-802f-dd73d82ae766 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /v2.0/ports?device_id=40591370-dbd3-45b4-b6c6-a0e01a614c28 HTTP/1.1" status: 200  len: 210 time: 0.0643940
May 26 15:05:29.449145 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:30.890355 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35388) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:31.412539 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6431ed44-bb34-4a76-bf6a-5f589562735a no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:31.447761 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 6431ed44-bb34-4a76-bf6a-5f589562735a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:31.448111 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 6431ed44-bb34-4a76-bf6a-5f589562735a not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:31.596509 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:31.839216 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35424) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:32.116754 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Deleting port 7d4cf06f-48f0-4f53-bdcb-f793e017b221 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:32.117333 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:32.240046 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] For port 7d4cf06f-48f0-4f53-bdcb-f793e017b221, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d4cf06f-48f0-4f53-bdcb-f793e017b221,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:32.240424 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:32.363276 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Calling delete_port for 7d4cf06f-48f0-4f53-bdcb-f793e017b221 owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:32.384673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:32.565245 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:32.569993 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-00df08cc-eaac-4a42-b177-5ee2d912eb38 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:32.616606 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Pushing event deleted for resources: {'Port': ['ID=7d4cf06f-48f0-4f53-bdcb-f793e017b221,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:32.642350 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:32.905433 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:32.926956 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Deleting port e1b444e0-d083-4f15-a3d0-2a82bf7344cc {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:32.928615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.048775 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35434) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:33.064424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] For port e1b444e0-d083-4f15-a3d0-2a82bf7344cc, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:33.064841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.194586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Calling delete_port for e1b444e0-d083-4f15-a3d0-2a82bf7344cc owned by network:router_interface {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:33.213479 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.231688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:33.247690 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Usage tracker for resource:security_group_rule and tenant:3de55d555caf455f837ca63c1b180320 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:33.251179 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:33.258462 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:33.290775 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Router 06efab40-5c90-4029-a486-99daed3d6b39 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:05:33.526971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.575078 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:05:33.584319 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25314816-a280-43ec-8594-87051fe1310f None None] Sync routers for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:05:33.591597 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-cdb86ac3-7a86-4d6e-8a2a-1bb75b79a719 admin admin] 10.222.0.81 "PUT /v2.0/routers/06efab40-5c90-4029-a486-99daed3d6b39/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6979847
May 26 15:05:33.591863 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35440) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:33.598457 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:33.599642 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4a96a60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:33.633223 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.640349 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:33.679225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.690292 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=3de55d555caf455f837ca63c1b180320&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6379938
May 26 15:05:33.692348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35444) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:33.693325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=607e02a3-0ea4-4495-afb1-05d2bf80a1d9,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:33.697983 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:33.700463 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7ef3aa91-03fc-4a72-955e-9c5d71fb8af4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.015s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:33.779283 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:33.785059 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.798194 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Pushing event deleted for resources: {'Port': ['ID=e1b444e0-d083-4f15-a3d0-2a82bf7344cc,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:33.834072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:33.960956 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:33.969815 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.058653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.089387 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4a96a60>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87'}], 'enable_snat': True}, 'gw_port_id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T15:05:32Z', 'revision_number': 5, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port': {'id': 'c7510518-5e9a-40d3-ba66-f34a4bd5522b', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:88:6b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '06efab40-5c90-4029-a486-99daed3d6b39', 'device_owner': 'network:router_gateway', 'standard_attr_id': 79, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.87', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:57:35Z', 'updated_at': '2021-05-26T14:57:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:34.093826 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25314816-a280-43ec-8594-87051fe1310f None None] Checking router: 06efab40-5c90-4029-a486-99daed3d6b39 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:05:34.096506 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Deleting port c7510518-5e9a-40d3-ba66-f34a4bd5522b {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:34.096732 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.103884 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] Routers {'06efab40-5c90-4029-a486-99daed3d6b39'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:34.104225 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4a96a60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['06efab40-5c90-4029-a486-99daed3d6b39'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:34.127242 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.232993 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] For port c7510518-5e9a-40d3-ba66-f34a4bd5522b, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=c7510518-5e9a-40d3-ba66-f34a4bd5522b,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:34.233691 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.266351 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] Set router 06efab40-5c90-4029-a486-99daed3d6b39 gateway port host: None {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:34.361006 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Calling delete_port for c7510518-5e9a-40d3-ba66-f34a4bd5522b owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:34.394340 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.399691 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0e1845ee-af27-4110-b245-65b46f99dad1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:34.409805 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-25314816-a280-43ec-8594-87051fe1310f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4a96a60>, [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T15:05:33Z', 'revision_number': 6, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:34.414452 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-25314816-a280-43ec-8594-87051fe1310f None None] The sync data for ids ['06efab40-5c90-4029-a486-99daed3d6b39'] in dv-cinder-784140-4-iscsi is: [{'id': '06efab40-5c90-4029-a486-99daed3d6b39', 'name': 'tempest-AttachVolumeShelveTestJSON-1886051916-router', 'tenant_id': '7555f6895a2a405685d8ccfe81fe5a74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:57:34Z', 'updated_at': '2021-05-26T15:05:33Z', 'revision_number': 6, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'gw_port_host': None}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:05:34.419704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=607e02a3-0ea4-4495-afb1-05d2bf80a1d9,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:34.431070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:34.504329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.506024 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/607e02a3-0ea4-4495-afb1-05d2bf80a1d9 HTTP/1.1" status: 204  len: 168 time: 0.8092182
May 26 15:05:34.586743 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.591556 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-eaef5157-c2e2-4c75-a111-6aaa830088ba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:34.629798 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Router 5f218ea9-44ea-4266-9fc8-01161ec57870 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:05:34.635601 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Pushing event deleted for resources: {'Port': ['ID=c7510518-5e9a-40d3-ba66-f34a4bd5522b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:34.638801 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:34.730470 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.816917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:05:34.825357 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] 10.222.0.81 "PUT /v2.0/routers/5f218ea9-44ea-4266-9fc8-01161ec57870/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.9819770
May 26 15:05:34.828349 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Sync routers for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:05:34.830046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35452) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:34.842338 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:34.843127 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac445edc0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:34.934252 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:34.936162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.038560 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks [] for router, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.056996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:35.089057 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.089623 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 06efab40-5c90-4029-a486-99daed3d6b39 {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:05:35.102484 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.106163 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] 10.222.0.81 "DELETE /v2.0/routers/06efab40-5c90-4029-a486-99daed3d6b39 HTTP/1.1" status: 204  len: 168 time: 1.5132585
May 26 15:05:35.106750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35456) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:35.172553 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Deleting subnet 09a19960-7788-4d46-a08e-92c63f201983 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:05:35.175663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.217016 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.233308 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.367460 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35460) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:35.388864 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac445edc0>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:05:33Z', 'revision_number': 5, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port': {'id': 'ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:69:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'device_owner': 'network:router_gateway', 'standard_attr_id': 512, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:43Z', 'updated_at': '2021-05-26T15:02:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:35.389499 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Checking router: 5f218ea9-44ea-4266-9fc8-01161ec57870 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:05:35.400126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.403080 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Routers {'5f218ea9-44ea-4266-9fc8-01161ec57870'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:35.404050 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac445edc0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['5f218ea9-44ea-4266-9fc8-01161ec57870'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:35.425345 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:35.430981 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Usage tracker for resource:security_group_rule and tenant:bb2976f136144137bddac9a7a508ef42 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:35.435240 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:35.444452 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:35.455836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.488342 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Deleting port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:35.488686 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.563023 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d4cf06f-48f0-4f53-bdcb-f793e017b221 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:35.598433 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 7d4cf06f-48f0-4f53-bdcb-f793e017b221 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:35.599417 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d4cf06f-48f0-4f53-bdcb-f793e017b221 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:35.600279 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device c7510518-5e9a-40d3-ba66-f34a4bd5522b no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:35.636909 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: c7510518-5e9a-40d3-ba66-f34a4bd5522b {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:35.637258 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device c7510518-5e9a-40d3-ba66-f34a4bd5522b not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:35.654761 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] Set router 5f218ea9-44ea-4266-9fc8-01161ec57870 gateway port host: None {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:35.659135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] For port ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:35.659520 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.764203 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac445edc0>, [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:05:35Z', 'revision_number': 6, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:35.768523 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffbb79fc-37f8-4a54-8da7-ac0904ad3991 None None] The sync data for ids ['5f218ea9-44ea-4266-9fc8-01161ec57870'] in dv-cinder-784140-4-iscsi is: [{'id': '5f218ea9-44ea-4266-9fc8-01161ec57870', 'name': 'tempest-TestMinimumBasicScenario-677153450-router', 'tenant_id': '83937b4f3831489289cd8aec97222f77', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:42Z', 'updated_at': '2021-05-26T15:05:35Z', 'revision_number': 6, 'project_id': '83937b4f3831489289cd8aec97222f77', 'gw_port_host': None}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:05:35.817994 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Calling delete_port for ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 owned by network:router_gateway {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:35.821639 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.834714 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.839526 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c0611ca9-3a2a-4dbd-a6b9-fb95585cf078 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:35.877298 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=09a19960-7788-4d46-a08e-92c63f201983,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:35.879378 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.882183 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:35.889318 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-35dc1187-64b0-4f2c-8a31-4c9cd9de1ed1 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/09a19960-7788-4d46-a08e-92c63f201983 HTTP/1.1" status: 204  len: 168 time: 0.7791202
May 26 15:05:35.894965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0de9f12f-f97b-41f9-b7c8-82236ea88ab6 None None] Network c010dc4d-023b-4979-a482-d3b3e0924e91 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:05:35.895524 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35464) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:35.944116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:35.953325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8476cd98-af4e-4c43-825f-9129547695d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:35.999744 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.007055 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=bb2976f136144137bddac9a7a508ef42&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6354034
May 26 15:05:36.013394 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35468) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:36.013585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de855651-43bd-4a7d-bdaa-61547a452647,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:36.015176 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ecd60880-644f-4ef1-981e-cf059c5c539f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:36.129230 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.167432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.188171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Deleting port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:36.190098 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.225859 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] DHCP port deletion for c010dc4d-023b-4979-a482-d3b3e0924e91 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:05:36.300969 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Deleting port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:36.301347 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.303707 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.322181 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:36.322413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] For port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:36.322413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.403171 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Pushing event deleted for resources: {'Port': ['ID=ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:36.406353 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] For port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,segment=NetworkSegment(e16500c6-bc20-4512-be7a-ff27e5886c30),segment_id=e16500c6-bc20-4512-be7a-ff27e5886c30)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:36.406837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.430196 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:36.449953 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Calling delete_port for 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:36.463400 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.512154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.516687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7d156a5f-bed4-4968-a7d7-b4e73c6cbff7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:36.531262 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de855651-43bd-4a7d-bdaa-61547a452647,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:36.533435 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Calling delete_port for 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:36.536704 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:36.543258 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.548625 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6b300d0f-7f87-4160-a789-dfca5a0992f5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/de855651-43bd-4a7d-bdaa-61547a452647 HTTP/1.1" status: 204  len: 168 time: 0.5362046
May 26 15:05:36.603735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.610348 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cbc88af9-d78f-4f24-b62a-c5eaedd95f30 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:36.612223 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.625606 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:36.649814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.652097 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.661070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Pushing event deleted for resources: {'Port': ['ID=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:36.663781 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:36.670078 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] No DVR routers for this DVR port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:36.690019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Pushing event deleted for resources: {'Port': ['ID=738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:36.698600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] No DVR routers for this DVR port 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:36.701101 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.701414 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.701853 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.702190 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.702575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.702910 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.703237 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.703558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.703883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.704205 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.704521 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.704869 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:36.713255 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:36.811775 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.825752 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac41c4790>,) {'filters': {'network_id': ['c010dc4d-023b-4979-a482-d3b3e0924e91']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:36.833613 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.834339 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5f218ea9-44ea-4266-9fc8-01161ec57870 {{(pid=103982) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:05:36.839663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac41c4790>, 'e16500c6-bc20-4512-be7a-ff27e5886c30') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:36.840008 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac41c4790>, 'e16500c6-bc20-4512-be7a-ff27e5886c30') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:36.852530 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.862394 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.863740 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] 10.222.0.81 "DELETE /v2.0/routers/5f218ea9-44ea-4266-9fc8-01161ec57870 HTTP/1.1" status: 204  len: 168 time: 2.0324559
May 26 15:05:36.867069 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35474) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:36.873077 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.879965 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Releasing vlan 1224 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:05:36.882206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:05:36.896101 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:05:36.961866 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Deleting subnet 6bf4d059-576f-4ff2-9b19-4983cc253018 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:05:36.964896 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.026185 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.033611 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.039902 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.044887 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:37.071092 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Pushing event deleted for resources: {'Network': ['ID=c010dc4d-023b-4979-a482-d3b3e0924e91,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:37.074463 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:37.143856 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] 10.222.0.81 "DELETE /v2.0/networks/c010dc4d-023b-4979-a482-d3b3e0924e91 HTTP/1.1" status: 204  len: 168 time: 1.2505765
May 26 15:05:37.153830 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.238222 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e1b444e0-d083-4f15-a3d0-2a82bf7344cc no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:37.275251 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: e1b444e0-d083-4f15-a3d0-2a82bf7344cc {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:37.275607 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e1b444e0-d083-4f15-a3d0-2a82bf7344cc not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:37.276038 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:37.309958 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:37.312935 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 738f2bc1-c9ab-4d9a-b12d-2b1a4b5d67f3 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:37.312935 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:37.346826 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:37.347186 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device ff9ea9bc-49ec-4e8e-8ed5-cdd203915e89 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:37.559805 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.564764 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2830fbc7-f14c-43ad-a6ef-43caf195b157 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:37.579742 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35490) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:37.598930 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6bf4d059-576f-4ff2-9b19-4983cc253018,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:37.601715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:37.602755 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.608847 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-e7968ecd-d1d3-4d74-8e7b-3fe2251f9325 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/6bf4d059-576f-4ff2-9b19-4983cc253018 HTTP/1.1" status: 204  len: 168 time: 0.7399015
May 26 15:05:37.613742 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35496) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:37.615324 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f80fd068-b6a9-48e2-bacd-12884eff4caa None None] Network 91d594ee-93aa-497d-af26-3f3353865830 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:05:37.638175 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-4795fcc7-0a0f-4a1e-8190-aa358e44636a admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=7555f6895a2a405685d8ccfe81fe5a74&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0569632
May 26 15:05:37.643037 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35500) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:37.719582 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.732447 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.751995 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.821431 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Deleting port 7d798e60-1ff9-40dd-a32e-991b01fbe25d {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:37.821715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.888439 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] DHCP port deletion for 91d594ee-93aa-497d-af26-3f3353865830 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:05:37.891132 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.907593 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e38e0658-bf68-4db9-b535-65b6ce85d4b2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:37.925354 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.926958 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4ca23e97-1854-408b-b83c-26e0752c75ef HTTP/1.1" status: 204  len: 168 time: 0.2829473
May 26 15:05:37.929444 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] For port 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d798e60-1ff9-40dd-a32e-991b01fbe25d,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:37.929835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:37.933284 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ca23e97-1854-408b-b83c-26e0752c75ef,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:37.941399 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-546b9a67-3a5f-4e29-b550-24ea9f07c3a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:37.976117 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Deleting port 7d798e60-1ff9-40dd-a32e-991b01fbe25d {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:37.976775 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.094077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] For port 7d798e60-1ff9-40dd-a32e-991b01fbe25d, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=7d798e60-1ff9-40dd-a32e-991b01fbe25d,segment=NetworkSegment(293b87b4-e7d6-44df-8223-0904a6af3b0e),segment_id=293b87b4-e7d6-44df-8223-0904a6af3b0e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:38.094077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.195900 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Calling delete_port for 7d798e60-1ff9-40dd-a32e-991b01fbe25d owned by network:dhcp {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:38.237398 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Calling delete_port for 7d798e60-1ff9-40dd-a32e-991b01fbe25d owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:38.324658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.330584 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.331115 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-07ca5143-28f0-40d3-b826-ffc713f09166 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:38.335733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-77952ba4-b1b9-41f5-a418-09ce3ae193d4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:38.374866 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Pushing event deleted for resources: {'Port': ['ID=7d798e60-1ff9-40dd-a32e-991b01fbe25d,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:38.378671 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Pushing event deleted for resources: {'Port': ['ID=7d798e60-1ff9-40dd-a32e-991b01fbe25d,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:38.381126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:38.383455 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] No DVR routers for this DVR port 7d798e60-1ff9-40dd-a32e-991b01fbe25d on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:38.386077 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:38.393474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] No DVR routers for this DVR port 7d798e60-1ff9-40dd-a32e-991b01fbe25d on host dv-cinder-784140-4-iscsi {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:38.512251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.526415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac45cb130>,) {'filters': {'network_id': ['91d594ee-93aa-497d-af26-3f3353865830']}} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:38.539214 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45cb130>, '293b87b4-e7d6-44df-8223-0904a6af3b0e') {'for_net_delete': True} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:38.540096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.services.segments.db [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45cb130>, '293b87b4-e7d6-44df-8223-0904a6af3b0e') {} {{(pid=103982) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:38.551015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2601870'] for segment, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.568295 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.574776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Releasing vlan 1205 on physical network physnet1 to pool {{(pid=103982) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:05:38.575161 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2528806'] for segment, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]: Traceback (most recent call last):
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     timer()
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     cb(*args, **kw)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     return func(*args, **kwargs)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     self._notify()
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     self.callback(batched_events)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     event.method(event)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     return f(self, *a, **k)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._get(url).json()
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     return self.request(url, 'GET', **kwargs)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:05:38.588752 dv-cinder-784140-4-iscsi neutron-server[103982]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:05:38.723515 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.727920 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b251c18a-fb9e-4806-a6a5-f6a3602f44f7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:38.742115 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:38.755011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Pushing event deleted for resources: {'Network': ['ID=91d594ee-93aa-497d-af26-3f3353865830,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:38.764540 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:38.764540 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] 10.222.0.81 "DELETE /v2.0/networks/91d594ee-93aa-497d-af26-3f3353865830 HTTP/1.1" status: 204  len: 168 time: 1.1470134
May 26 15:05:38.765433 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35526) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:39.204901 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d798e60-1ff9-40dd-a32e-991b01fbe25d no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:39.243623 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 7d798e60-1ff9-40dd-a32e-991b01fbe25d {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:39.243963 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 7d798e60-1ff9-40dd-a32e-991b01fbe25d not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:39.436162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:39.850981 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Deleting port 5d5560a2-c522-4536-9b60-b40d733fe8dd {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:39.851644 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:39.975460 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] For port 5d5560a2-c522-4536-9b60-b40d733fe8dd, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=5d5560a2-c522-4536-9b60-b40d733fe8dd,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:39.975763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:40.099317 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Calling delete_port for 5d5560a2-c522-4536-9b60-b40d733fe8dd owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:40.313782 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:40.319347 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8ef9bdcc-6844-477f-a03b-34c9aceadae0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:40.369613 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Pushing event deleted for resources: {'Port': ['ID=5d5560a2-c522-4536-9b60-b40d733fe8dd,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:40.402942 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:40.785786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.084838 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35586) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:41.228377 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Router 77beb3ec-f440-47ad-81e0-105d4f2f195c has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:05:41.259922 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.281165 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:41.285145 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Usage tracker for resource:security_group_rule and tenant:db3bfaba715f47968b3b2658329a78ef is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:41.289431 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:41.297749 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:41.409262 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.477687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:05:41.487809 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Sync routers for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:05:41.499174 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:41.499860 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b200d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:41.508287 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.517726 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f663a5bd-38d9-4c97-a8a6-ca1ae4fac600 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:41.566623 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=db3bfaba715f47968b3b2658329a78ef&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4805369
May 26 15:05:41.569244 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77a090bd-0258-4047-9799-1fccd9b7e5c9,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:41.569929 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35600) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:41.589043 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:41.604875 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] 10.222.0.81 "PUT /v2.0/routers/77beb3ec-f440-47ad-81e0-105d4f2f195c/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8390763
May 26 15:05:41.608338 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35604) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:41.697357 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:41.745182 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.844536 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.874918 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:41.995481 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b200d0>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:05:40Z', 'revision_number': 5, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:41.999422 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Checking router: 77beb3ec-f440-47ad-81e0-105d4f2f195c for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:05:42.008581 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Routers {'77beb3ec-f440-47ad-81e0-105d4f2f195c'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:05:42.009186 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b200d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['77beb3ec-f440-47ad-81e0-105d4f2f195c'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:42.062877 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.113735 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.119392 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-530ec09d-de44-47ad-b518-535328c7ec22 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:42.133217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77a090bd-0258-4047-9799-1fccd9b7e5c9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:42.171679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.172063 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.172436 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.172796 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.173155 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.173514 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.173894 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.174251 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.174605 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.174956 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.175303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.175652 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:05:42.178384 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.179500 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/77a090bd-0258-4047-9799-1fccd9b7e5c9 HTTP/1.1" status: 204  len: 168 time: 0.6085858
May 26 15:05:42.180442 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1d90529d-7da8-4b31-97d3-1cb5f0134700 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:42.203993 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] Set router 77beb3ec-f440-47ad-81e0-105d4f2f195c gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:05:42.228537 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Deleting port e5bc55b5-4029-49ed-a534-f75fa46e3c66 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:42.229105 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.355070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] For port e5bc55b5-4029-49ed-a534-f75fa46e3c66, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=e5bc55b5-4029-49ed-a534-f75fa46e3c66,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:42.355442 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.506265 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b200d0>, [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:05:40Z', 'revision_number': 5, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:42.510146 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-91dd3c68-8a47-4f19-ba47-4697e3d378e2 None None] The sync data for ids ['77beb3ec-f440-47ad-81e0-105d4f2f195c'] in dv-cinder-784140-4-iscsi is: [{'id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'name': 'tempest-TestMinimumBasicScenario-1829784076-router', 'tenant_id': '298f387c22874d8cbf8b86ab642c6bc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:02:52Z', 'updated_at': '2021-05-26T15:05:40Z', 'revision_number': 5, 'project_id': '298f387c22874d8cbf8b86ab642c6bc1', 'gw_port': {'id': 'e5bc55b5-4029-49ed-a534-f75fa46e3c66', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:4c:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '77beb3ec-f440-47ad-81e0-105d4f2f195c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 531, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:02:54Z', 'updated_at': '2021-05-26T15:03:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:05:42.597848 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Calling delete_port for e5bc55b5-4029-49ed-a534-f75fa46e3c66 owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:42.788966 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.794754 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e2fc9231-a615-4991-984b-98de0ef08d9e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:42.795825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35618) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:42.814520 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.829825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:42.835148 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Usage tracker for resource:security_group_rule and tenant:44041c17c4e34ccfbf68db5897813bf4 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:42.839086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:42.839464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Pushing event deleted for resources: {'Port': ['ID=e5bc55b5-4029-49ed-a534-f75fa46e3c66,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:42.842627 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:42.846008 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:42.935603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.936543 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:42.999285 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.007377 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a5aeeaa6-54e3-4219-bf38-d5fec036b136 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:43.047899 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5a959f56-999e-4e71-8924-9579d789271f,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:43.051309 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:43.054438 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=44041c17c4e34ccfbf68db5897813bf4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2575543
May 26 15:05:43.057875 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35622) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:43.123788 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.127954 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.130213 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.152375 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.212815 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 5d5560a2-c522-4536-9b60-b40d733fe8dd no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:43.216090 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.216648 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 77beb3ec-f440-47ad-81e0-105d4f2f195c {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:05:43.241002 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.244404 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] 10.222.0.81 "DELETE /v2.0/routers/77beb3ec-f440-47ad-81e0-105d4f2f195c HTTP/1.1" status: 204  len: 168 time: 1.6329410
May 26 15:05:43.244790 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35630) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:43.258249 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 5d5560a2-c522-4536-9b60-b40d733fe8dd {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:43.258716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 5d5560a2-c522-4536-9b60-b40d733fe8dd not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:43.289004 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.298719 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-36acfc88-eb1a-45f9-a320-1c315b882633 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:43.322617 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a959f56-999e-4e71-8924-9579d789271f,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:43.334481 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:43.351202 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_v2 [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Deleting subnet 4283290b-0d37-48e7-af9c-f99554271f55 {{(pid=103982) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:05:43.354644 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.355822 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d2cf8bb4-127f-4f31-986c-c06ba5d8057c admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/5a959f56-999e-4e71-8924-9579d789271f HTTP/1.1" status: 204  len: 168 time: 0.2970178
May 26 15:05:43.356778 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.419349 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2601911'] for subnet, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.497873 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.765857 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35640) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:43.834723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2528388', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2650436'] for subnet, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.843273 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1eda760f-46e0-4c92-aa21-e6820bf2dd44 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:43.900059 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.905143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3d106f75-9d30-4203-b408-250862bb14db None None] Network eea6c2fb-29bc-4ead-92f8-0304ed714d21 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:05:43.907278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4283290b-0d37-48e7-af9c-f99554271f55,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:43.912224 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:43.923915 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:43.931200 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-80799a0b-2413-4002-9da0-a55e4f891c55 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/4283290b-0d37-48e7-af9c-f99554271f55 HTTP/1.1" status: 204  len: 168 time: 0.6831005
May 26 15:05:43.931398 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:05:43.931886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35652) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:43.935444 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Usage tracker for resource:security_group_rule and tenant:03551e6dcdb44304bc5664b20d747bf5 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:05:43.938387 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:05:43.944723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:05:44.042198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.054887 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.123274 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.132891 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Deleting port 1daaadc3-28e1-4ca5-9439-225498a1194f {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:44.135505 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.135625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f06effea-6514-4490-905d-539b3ce42461 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:44.181146 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=03551e6dcdb44304bc5664b20d747bf5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4136963
May 26 15:05:44.181952 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fde5fe5-dfce-43e3-9206-fdb5905a9c84,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:44.184279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35660) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:44.186869 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f43f1d4e-6324-4cb9-92fa-59575330ac0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:44.211425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] DHCP port deletion for eea6c2fb-29bc-4ead-92f8-0304ed714d21 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:05:44.254284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.256155 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] For port 1daaadc3-28e1-4ca5-9439-225498a1194f, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1daaadc3-28e1-4ca5-9439-225498a1194f,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:44.256726 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.285839 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.294526 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Deleting port 1daaadc3-28e1-4ca5-9439-225498a1194f {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:05:44.295873 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.388297 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Calling delete_port for 1daaadc3-28e1-4ca5-9439-225498a1194f owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:44.407006 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] For port 1daaadc3-28e1-4ca5-9439-225498a1194f, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1daaadc3-28e1-4ca5-9439-225498a1194f,segment=NetworkSegment(df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6),segment_id=df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:05:44.407407 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.456166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.461701 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ae8b16f3-975b-4310-aa2e-a0cadadb92b3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:44.475321 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fde5fe5-dfce-43e3-9206-fdb5905a9c84,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:44.477975 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:44.479214 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.486509 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-dc2bde8b-d40c-4831-9339-ecad5685a0e5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4fde5fe5-dfce-43e3-9206-fdb5905a9c84 HTTP/1.1" status: 204  len: 168 time: 0.2951436
May 26 15:05:44.506272 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.511086 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-bc6e36bc-7f83-4d08-98f0-0bbd63feac8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:44.543217 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Calling delete_port for 1daaadc3-28e1-4ca5-9439-225498a1194f owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:05:44.560352 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Pushing event deleted for resources: {'Port': ['ID=1daaadc3-28e1-4ca5-9439-225498a1194f,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:44.564158 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:44.566352 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] No DVR routers for this DVR port 1daaadc3-28e1-4ca5-9439-225498a1194f on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:44.597807 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.604239 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:44.660969 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Pushing event deleted for resources: {'Port': ['ID=1daaadc3-28e1-4ca5-9439-225498a1194f,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:44.667467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] No DVR routers for this DVR port 1daaadc3-28e1-4ca5-9439-225498a1194f on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:05:44.669064 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-eda498ca-2ddc-4024-bdfc-3da832cd34a0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:44.688868 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.702060 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac4029820>,) {'filters': {'network_id': ['eea6c2fb-29bc-4ead-92f8-0304ed714d21']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:44.715987 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4029820>, 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:44.716286 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac4029820>, 'df05e7ff-190d-4942-bdf4-6e5cdbf6b1a6') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:05:44.728192 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.744732 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.750935 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Releasing vlan 1203 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:05:44.751383 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:05:44.764752 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:05:45.003561 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.007581 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2f9399b6-8d03-4fcb-8241-b651a8df9828 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:45.027073 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.037511 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Pushing event deleted for resources: {'Network': ['ID=eea6c2fb-29bc-4ead-92f8-0304ed714d21,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:45.042166 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:45.045013 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d450c58b-9f68-4f5a-ad2c-db138f27f5de admin admin] 10.222.0.81 "DELETE /v2.0/networks/eea6c2fb-29bc-4ead-92f8-0304ed714d21 HTTP/1.1" status: 204  len: 168 time: 1.1121902
May 26 15:05:45.204561 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e5bc55b5-4029-49ed-a534-f75fa46e3c66 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:45.239143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: e5bc55b5-4029-49ed-a534-f75fa46e3c66 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:45.239516 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device e5bc55b5-4029-49ed-a534-f75fa46e3c66 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:45.239962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1daaadc3-28e1-4ca5-9439-225498a1194f no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:05:45.272953 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 1daaadc3-28e1-4ca5-9439-225498a1194f {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:05:45.273292 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1daaadc3-28e1-4ca5-9439-225498a1194f not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:05:45.551325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35704) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:45.609118 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f20c05ff-04e5-4e13-99d6-a23146faad58 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=83937b4f3831489289cd8aec97222f77&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0551462
May 26 15:05:45.611312 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35708) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:45.671622 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.699640 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.810340 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.815650 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-50448f77-0e1e-46c2-b669-f50c620110b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:45.829996 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c346a6a-0742-44bc-b430-b584c9e11507,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:45.838404 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:45.917777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:45.918904 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a847b075-c9c5-4800-9ec0-39319873f10e admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/4c346a6a-0742-44bc-b430-b584c9e11507 HTTP/1.1" status: 204  len: 168 time: 0.3066702
May 26 15:05:46.689648 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35770) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:46.739043 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-81cfd1ec-6de5-4422-856c-bedfb7e15eb8 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=298f387c22874d8cbf8b86ab642c6bc1&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0480886
May 26 15:05:46.741679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 35774) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:05:46.801197 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:46.827254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:46.959663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:46.964927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6d1b848d-2724-4bcb-b956-d19bcdf09a1c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:05:46.975329 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b930397-969c-44e0-a47d-103b267b2f8a,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:05:46.977639 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:05:46.984167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:46.987723 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/3b930397-969c-44e0-a47d-103b267b2f8a HTTP/1.1" status: 204  len: 168 time: 0.2428207
May 26 15:05:50.490517 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5ce15ffa-bb50-4741-8a01-ca2ca8bf9352 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:53.094593 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:53.170862 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6f045d3c-1672-4655-b4dd-50ddc2992a69 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:54.124738 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:55.610325 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:59.443137 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:05:59.807359 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 35904) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:00.284391 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:06:00.294086 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Deleting port 13c850a5-9564-48ac-9c3a-5a190d91437c {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:00.294422 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:00.508372 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:00.508702 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:00.640562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling delete_port for 13c850a5-9564-48ac-9c3a-5a190d91437c owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:00.843435 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:00.847938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a30ab5c2-89d9-43bb-80d8-c2c593d8ebd4 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:00.894256 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event deleted for resources: {'Port': ['ID=13c850a5-9564-48ac-9c3a-5a190d91437c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:00.897722 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:00.985082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:00.985414 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Floating IP 0843ca0f-dd64-491b-924f-ca6157719f64 disassociated (deleted). External IP: 172.27.2.54, port: 24388d3c-fd02-41f5-996a-da7452902c2b.
May 26 15:06:01.344172 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:06:01.526328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:06:01.539222 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Sync routers for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:06:01.548320 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:01.548938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4462670>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:01.633688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:01.695897 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "DELETE /v2.0/floatingips/0843ca0f-dd64-491b-924f-ca6157719f64 HTTP/1.1" status: 204  len: 168 time: 1.8849268
May 26 15:06:01.695897 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:06:01.744595 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'status': 'completed', 'code': 200}
May 26 15:06:01.744798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:01.864043 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-cd43f177-cb44-4e2c-b0f5-8c6b1f606405 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:01.866513 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-cd43f177-cb44-4e2c-b0f5-8c6b1f606405 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=07c65d1e254f424ebfea8360aa697c34&device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 1098 time: 0.0926878
May 26 15:06:02.018294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-6c76a506-b0c7-4532-a81f-e73be31fbe28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:02.020073 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-6c76a506-b0c7-4532-a81f-e73be31fbe28 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 200  len: 911 time: 0.1465251
May 26 15:06:02.097836 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4462670>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:02.101408 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Checking router: 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:06:02.111169 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:02.111899 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4462670>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:02.218128 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-d1214fb3-2a7d-436e-8536-8bc51ad16c9d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 200  len: 217 time: 0.1883616
May 26 15:06:02.297368 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-d015c449-db73-4d34-bf19-a2bd77b5cb92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:02.299308 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-d015c449-db73-4d34-bf19-a2bd77b5cb92 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 200  len: 848 time: 0.0734272
May 26 15:06:02.363545 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:02.392110 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 req-3412f51b-a5ed-4543-91be-7f3c4835f46e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:02.393790 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 req-3412f51b-a5ed-4543-91be-7f3c4835f46e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1192641
May 26 15:06:02.408963 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-ca489c38-9e9e-4fe9-865f-e1e7779b7cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:02.410541 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-ca489c38-9e9e-4fe9-865f-e1e7779b7cf6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e30d7c90-8779-49cd-96d8-5c4ae28c55f9&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1002414
May 26 15:06:02.447493 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 req-fa72063e-f0a1-4484-bc81-14424c4ab78d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0469120
May 26 15:06:02.561140 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-2f30422a-89f4-4729-a9c3-b50d9fcd4b07 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1418686
May 26 15:06:02.699083 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-c8d4c216-c06b-4f05-87ed-29f493514b87 service neutron] 10.222.0.32 "GET /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1307268
May 26 15:06:02.719998 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4462670>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:02.724505 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28284895-e77f-4c2d-bb27-9be451b7d7a9 None None] The sync data for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi is: [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:00:00Z', 'revision_number': 4, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '093539a9-fe4c-473b-afed-760a8fa8122e', 'name': '', 'network_id': 'e30d7c90-8779-49cd-96d8-5c4ae28c55f9', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'mac_address': 'fa:16:3e:52:32:76', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_interface', 'standard_attr_id': 371, 'fixed_ips': [{'subnet_id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:58Z', 'updated_at': '2021-05-26T15:00:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'subnets': [{'id': 'f8df0d21-cfe4-4e67-913c-771912dae169', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:06:02.931417 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98b5e1f8-fa06-4c73-bde3-7a52c9d4fb18 None None] New status for floating IP 0843ca0f-dd64-491b-924f-ca6157719f64: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:06:03.649616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad702e16-4d54-4e33-8414-1783a2d33666 req-55ddf781-9a73-4c5d-afb6-f470fc27bbfd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:03.650305 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ad702e16-4d54-4e33-8414-1783a2d33666 req-55ddf781-9a73-4c5d-afb6-f470fc27bbfd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:06:03.735981 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ad702e16-4d54-4e33-8414-1783a2d33666 req-55ddf781-9a73-4c5d-afb6-f470fc27bbfd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:06:03.737184 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad702e16-4d54-4e33-8414-1783a2d33666 req-55ddf781-9a73-4c5d-afb6-f470fc27bbfd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.1715372
May 26 15:06:03.783010 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ad702e16-4d54-4e33-8414-1783a2d33666 req-7cb6fcc7-5a5e-48f8-ac12-06c7f07c07df tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/security-groups?id=e529f520-2545-4975-afd4-3361721fae1d&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396204
May 26 15:06:03.902803 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-ecb2c707-d3a1-401f-a094-bec6e40b9bb2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:06:03.904219 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-ecb2c707-d3a1-401f-a094-bec6e40b9bb2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.32 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 945 time: 0.0806093
May 26 15:06:04.049634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Deleting port 24388d3c-fd02-41f5-996a-da7452902c2b {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:04.049979 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:04.188545 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] For port 24388d3c-fd02-41f5-996a-da7452902c2b, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=24388d3c-fd02-41f5-996a-da7452902c2b,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:04.189085 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:04.322474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling delete_port for 24388d3c-fd02-41f5-996a-da7452902c2b owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:04.494563 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:04.500238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9c3aeaff-fdc4-4e2c-9de5-ec0862b4ffa1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:04.546075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event deleted for resources: {'Port': ['ID=24388d3c-fd02-41f5-996a-da7452902c2b,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:04.549595 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:04.644270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] No DVR routers for this DVR port 24388d3c-fd02-41f5-996a-da7452902c2b on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:06:04.646686 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:04.650169 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-deleted', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:06:04.695614 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de', 'name': 'network-vif-deleted', 'tag': '24388d3c-fd02-41f5-996a-da7452902c2b', 'status': 'completed', 'code': 200}
May 26 15:06:04.729950 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e4c03e0f-9400-4a53-910a-c58fa15197cf req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.32 "DELETE /v2.0/ports/24388d3c-fd02-41f5-996a-da7452902c2b HTTP/1.1" status: 204  len: 173 time: 0.8177164
May 26 15:06:04.935465 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ed852fb7-0811-41da-868d-368175ef2317 req-b1624054-f06f-4ff4-9570-51c25eda4129 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Synchronizing usage tracker for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:06:05.043485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-ed852fb7-0811-41da-868d-368175ef2317 req-b1624054-f06f-4ff4-9570-51c25eda4129 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Unset dirty status for tenant:07c65d1e254f424ebfea8360aa697c34 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:06:05.044676 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ed852fb7-0811-41da-868d-368175ef2317 req-b1624054-f06f-4ff4-9570-51c25eda4129 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.1550105
May 26 15:06:06.212330 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba req-ca9907ba-3a2a-4b2b-821e-aeafb1c29783 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /v2.0/ports?device_id=29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de HTTP/1.1" status: 200  len: 210 time: 0.0438392
May 26 15:06:07.308440 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36006) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:07.385475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:07.417249 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:07.551504 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:07.555439 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-06a836de-c0da-4538-a998-e91206b498df admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:07.570947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e529f520-2545-4975-afd4-3361721fae1d,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:07.573564 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:07.642198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:07.643375 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "DELETE /v2.0/security-groups/e529f520-2545-4975-afd4-3361721fae1d HTTP/1.1" status: 204  len: 168 time: 0.3339517
May 26 15:06:07.763469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36016) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:07.917262 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:07.954549 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 24388d3c-fd02-41f5-996a-da7452902c2b {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:07.954811 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 24388d3c-fd02-41f5-996a-da7452902c2b not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:08.489862 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:08.894494 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Deleting port 093539a9-fe4c-473b-afed-760a8fa8122e {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:08.894831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:09.020137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] For port 093539a9-fe4c-473b-afed-760a8fa8122e, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=093539a9-fe4c-473b-afed-760a8fa8122e,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:09.020393 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:09.146072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Calling delete_port for 093539a9-fe4c-473b-afed-760a8fa8122e owned by network:router_interface {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:09.353238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:09.357095 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-db1ce129-40af-4592-bf79-61a36390c4d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:09.403050 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Pushing event deleted for resources: {'Port': ['ID=093539a9-fe4c-473b-afed-760a8fa8122e,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:09.406183 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:09.773676 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:10.143038 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:06:10.322741 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:06:10.331234 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Sync routers for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:06:10.340350 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:10.340914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac43b6190>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:10.412116 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-a02b136d-2c22-43b2-8452-b6922fff12fd admin admin] 10.222.0.81 "PUT /v2.0/routers/21afcaa4-cfbc-4718-bbaf-c9f06d0940e0/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6473231
May 26 15:06:10.414532 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36034) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:10.516545 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:10.591927 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks [] for router, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:10.774515 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:10.811094 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac43b6190>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131'}], 'enable_snat': True}, 'gw_port_id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:06:09Z', 'revision_number': 5, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port': {'id': '62f5a1b2-488b-45ed-b46e-e4fab6772517', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:9c:84:e8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 370, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.131', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T14:59:53Z', 'updated_at': '2021-05-26T15:00:02Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:10.814997 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Checking router: 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:06:10.824095 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Routers {'21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:10.824709 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac43b6190>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:10.920072 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Deleting port 62f5a1b2-488b-45ed-b46e-e4fab6772517 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:10.927598 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:10.983798 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] Set router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 gateway port host: None {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:11.060553 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] For port 62f5a1b2-488b-45ed-b46e-e4fab6772517, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=62f5a1b2-488b-45ed-b46e-e4fab6772517,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:11.061046 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.094620 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac43b6190>, [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:06:10Z', 'revision_number': 6, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:11.108604 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de99711-1bbe-43e0-84d7-2b3fbce0c2a1 None None] The sync data for ids ['21afcaa4-cfbc-4718-bbaf-c9f06d0940e0'] in dv-cinder-784140-4-iscsi is: [{'id': '21afcaa4-cfbc-4718-bbaf-c9f06d0940e0', 'name': 'tempest-TestShelveInstance-1060392281-router', 'tenant_id': '07c65d1e254f424ebfea8360aa697c34', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T14:59:52Z', 'updated_at': '2021-05-26T15:06:10Z', 'revision_number': 6, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'gw_port_host': None}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:06:11.197516 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Calling delete_port for 62f5a1b2-488b-45ed-b46e-e4fab6772517 owned by network:router_gateway {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:11.504491 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 093539a9-fe4c-473b-afed-760a8fa8122e no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:11.530789 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.535665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-35495383-6a7b-4c4a-92e0-211c58a13e6d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:11.543996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 093539a9-fe4c-473b-afed-760a8fa8122e {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:11.544355 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 093539a9-fe4c-473b-afed-760a8fa8122e not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:11.587450 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Pushing event deleted for resources: {'Port': ['ID=62f5a1b2-488b-45ed-b46e-e4fab6772517,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:11.590816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:11.681756 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.861291 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.863446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.969047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.969578 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 {{(pid=103982) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:06:11.982556 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:11.983702 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] 10.222.0.81 "DELETE /v2.0/routers/21afcaa4-cfbc-4718-bbaf-c9f06d0940e0 HTTP/1.1" status: 204  len: 168 time: 1.5682075
May 26 15:06:11.986385 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36056) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:12.058351 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Deleting subnet f8df0d21-cfe4-4e67-913c-771912dae169 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:06:12.061469 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.118326 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.212339 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.519160 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.524636 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:12.563278 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f8df0d21-cfe4-4e67-913c-771912dae169,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:12.565207 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.567682 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:12.569805 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-96a4a475-258b-4158-9e56-9caa21961d74 None None] Network e30d7c90-8779-49cd-96d8-5c4ae28c55f9 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:06:12.572033 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/f8df0d21-cfe4-4e67-913c-771912dae169 HTTP/1.1" status: 204  len: 168 time: 0.5845468
May 26 15:06:12.574619 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36066) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:12.681482 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.754167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Deleting port 740e718d-231f-4d65-bc95-2ee9f35b897c {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:12.754515 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.860021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] For port 740e718d-231f-4d65-bc95-2ee9f35b897c, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=740e718d-231f-4d65-bc95-2ee9f35b897c,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:12.860270 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.862475 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] DHCP port deletion for e30d7c90-8779-49cd-96d8-5c4ae28c55f9 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:06:12.937045 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Deleting port 740e718d-231f-4d65-bc95-2ee9f35b897c {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:12.938830 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:12.985570 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Calling delete_port for 740e718d-231f-4d65-bc95-2ee9f35b897c owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:13.039015 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] For port 740e718d-231f-4d65-bc95-2ee9f35b897c, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=740e718d-231f-4d65-bc95-2ee9f35b897c,segment=NetworkSegment(d854f15e-4f6e-4459-9574-2252ec12295e),segment_id=d854f15e-4f6e-4459-9574-2252ec12295e)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:13.039415 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.117326 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.122870 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0b5baa28-0e2f-4dc0-b319-ba8c6828bc6c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:13.159402 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Calling delete_port for 740e718d-231f-4d65-bc95-2ee9f35b897c owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:13.170953 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Pushing event deleted for resources: {'Port': ['ID=740e718d-231f-4d65-bc95-2ee9f35b897c,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:13.172935 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] No DVR routers for this DVR port 740e718d-231f-4d65-bc95-2ee9f35b897c on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:06:13.174349 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:13.215568 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.224626 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:13.267000 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 62f5a1b2-488b-45ed-b46e-e4fab6772517 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:13.293427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.307433 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac471d0a0>,) {'filters': {'network_id': ['e30d7c90-8779-49cd-96d8-5c4ae28c55f9']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:13.317380 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Pushing event deleted for resources: {'Port': ['ID=740e718d-231f-4d65-bc95-2ee9f35b897c,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:13.321115 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac471d0a0>, 'd854f15e-4f6e-4459-9574-2252ec12295e') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:13.321292 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 62f5a1b2-488b-45ed-b46e-e4fab6772517 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:13.321419 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac471d0a0>, 'd854f15e-4f6e-4459-9574-2252ec12295e') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:13.321566 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 62f5a1b2-488b-45ed-b46e-e4fab6772517 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:13.321566 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 740e718d-231f-4d65-bc95-2ee9f35b897c no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:13.333025 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.350464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.359025 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Releasing vlan 1218 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:06:13.359481 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.364564 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:13.365508 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0b8e1d55-5756-4f3b-95bf-9940f39c32dd None None] No DVR routers for this DVR port 740e718d-231f-4d65-bc95-2ee9f35b897c on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:06:13.367283 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 740e718d-231f-4d65-bc95-2ee9f35b897c {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:13.367791 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 740e718d-231f-4d65-bc95-2ee9f35b897c not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:06:13.375750 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:06:13.622072 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.625764 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e10c0c58-24be-4c47-8722-4dbef3e0f5d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:13.639703 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:13.652220 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Pushing event deleted for resources: {'Network': ['ID=e30d7c90-8779-49cd-96d8-5c4ae28c55f9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:13.656789 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:13.765240 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] 10.222.0.81 "DELETE /v2.0/networks/e30d7c90-8779-49cd-96d8-5c4ae28c55f9 HTTP/1.1" status: 204  len: 168 time: 1.1895723
May 26 15:06:13.768040 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36084) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:14.294070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:14.694873 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Deleting port df9a0739-5987-4fbd-945a-00feffe90d14 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:14.695338 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:14.821756 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] For port df9a0739-5987-4fbd-945a-00feffe90d14, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=df9a0739-5987-4fbd-945a-00feffe90d14,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:14.822138 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:14.947383 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Calling delete_port for df9a0739-5987-4fbd-945a-00feffe90d14 owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:15.135866 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:15.140206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e0eeb736-5567-42c3-8c98-840c878607a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:15.317518 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Pushing event deleted for resources: {'Port': ['ID=df9a0739-5987-4fbd-945a-00feffe90d14,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:15.324603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:15.544360 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:15.895643 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Router 9c922391-3664-47fa-841b-f46221e134d0 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:06:16.076693 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:06:16.085225 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Sync routers for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:06:16.086035 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] 10.222.0.81 "PUT /v2.0/routers/9c922391-3664-47fa-841b-f46221e134d0/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.3169932
May 26 15:06:16.088464 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36106) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:16.098984 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:16.099594 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5113d60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:16.265209 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:16.315396 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:16.444051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:16.590322 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Deleting port a54b16fc-2508-4b0e-909e-8d12d563ccaa {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:16.590665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:16.596342 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5113d60>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93'}], 'enable_snat': True}, 'gw_port_id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:06:15Z', 'revision_number': 5, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port': {'id': 'a54b16fc-2508-4b0e-909e-8d12d563ccaa', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:e0:28:c7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9c922391-3664-47fa-841b-f46221e134d0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 382, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:00:11Z', 'updated_at': '2021-05-26T15:00:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:16.601732 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Checking router: 9c922391-3664-47fa-841b-f46221e134d0 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:06:16.610176 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Routers {'9c922391-3664-47fa-841b-f46221e134d0'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:06:16.610772 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac5113d60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:05:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['9c922391-3664-47fa-841b-f46221e134d0'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:16.769464 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] Set router 9c922391-3664-47fa-841b-f46221e134d0 gateway port host: None {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:06:16.828413 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] For port a54b16fc-2508-4b0e-909e-8d12d563ccaa, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a54b16fc-2508-4b0e-909e-8d12d563ccaa,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:16.828804 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:16.873718 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac5113d60>, [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:06:16Z', 'revision_number': 6, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:16.877838 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06a6335c-e3c5-4d5f-91ed-c85d7fc9adff None None] The sync data for ids ['9c922391-3664-47fa-841b-f46221e134d0'] in dv-cinder-784140-4-iscsi is: [{'id': '9c922391-3664-47fa-841b-f46221e134d0', 'name': 'tempest-TestShelveInstance-1907873096-router', 'tenant_id': 'e45a0526c7fe43899d670e392bac47de', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:00:09Z', 'updated_at': '2021-05-26T15:06:16Z', 'revision_number': 6, 'project_id': 'e45a0526c7fe43899d670e392bac47de', 'gw_port_host': None}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:06:16.953532 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Calling delete_port for a54b16fc-2508-4b0e-909e-8d12d563ccaa owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:17.163165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.167979 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-8db59a4c-ea53-47df-b273-be9cc57e5278 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:17.215783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Pushing event deleted for resources: {'Port': ['ID=a54b16fc-2508-4b0e-909e-8d12d563ccaa,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:17.242157 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:17.320663 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.363198 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device df9a0739-5987-4fbd-945a-00feffe90d14 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:17.400296 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: df9a0739-5987-4fbd-945a-00feffe90d14 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:17.400651 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device df9a0739-5987-4fbd-945a-00feffe90d14 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:17.496195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.498307 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.582000 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.582512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9c922391-3664-47fa-841b-f46221e134d0 {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:06:17.594236 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.595359 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-928ef344-df8a-407c-a6e3-f3895355e483 admin admin] 10.222.0.81 "DELETE /v2.0/routers/9c922391-3664-47fa-841b-f46221e134d0 HTTP/1.1" status: 204  len: 168 time: 1.5059996
May 26 15:06:17.597932 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36116) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:17.659837 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Deleting subnet c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:06:17.662892 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.712074 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:17.792340 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.103011 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.107173 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-96d0293d-5404-408a-ba9a-90c347645666 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:18.140356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:18.143820 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:18.146499 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.153320 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a07c4f13-da13-4f9f-aaeb-cb9a71ae1059 None None] Network 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:06:18.153838 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] 10.222.0.81 "DELETE /v2.0/subnets/c8966586-2e69-4d9f-a8e1-6bb6e0cebdf9 HTTP/1.1" status: 204  len: 168 time: 0.5549524
May 26 15:06:18.156312 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36124) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:18.263820 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.336952 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Deleting port a883160d-7880-408a-8d86-7c33acef58b5 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:18.337284 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.403038 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] DHCP port deletion for 93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:06:18.512682 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Deleting port a883160d-7880-408a-8d86-7c33acef58b5 {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:06:18.513237 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.591265 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] For port a883160d-7880-408a-8d86-7c33acef58b5, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a883160d-7880-408a-8d86-7c33acef58b5,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:18.591900 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.671816 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] For port a883160d-7880-408a-8d86-7c33acef58b5, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=a883160d-7880-408a-8d86-7c33acef58b5,segment=NetworkSegment(e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b),segment_id=e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:06:18.672422 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.791174 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Calling delete_port for a883160d-7880-408a-8d86-7c33acef58b5 owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:18.847960 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Calling delete_port for a883160d-7880-408a-8d86-7c33acef58b5 owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:06:18.919107 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.922940 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d42a7762-811d-4c4a-8053-7ecec2e72fbf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:18.924269 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:18.929439 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:18.969083 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Pushing event deleted for resources: {'Port': ['ID=a883160d-7880-408a-8d86-7c33acef58b5,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:18.971394 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Pushing event deleted for resources: {'Port': ['ID=a883160d-7880-408a-8d86-7c33acef58b5,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:18.972179 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:18.972947 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] No DVR routers for this DVR port a883160d-7880-408a-8d86-7c33acef58b5 on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:06:18.973171 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] No DVR routers for this DVR port a883160d-7880-408a-8d86-7c33acef58b5 on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:06:18.974524 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-e34d2273-746e-4c92-808d-ed8dcf320241 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:19.091107 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.104830 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac46d6d90>,) {'filters': {'network_id': ['93bb6fb9-a4aa-410c-ad6f-f2197fd69da3']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:19.118286 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac46d6d90>, 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:19.118581 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac46d6d90>, 'e22ba9a0-4802-4f8d-a35a-32e72d1ffc5b') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:06:19.130113 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.145681 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.152236 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Releasing vlan 1226 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:06:19.152655 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:06:19.166105 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:06:19.218255 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a54b16fc-2508-4b0e-909e-8d12d563ccaa no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:19.253446 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: a54b16fc-2508-4b0e-909e-8d12d563ccaa {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:19.253754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a54b16fc-2508-4b0e-909e-8d12d563ccaa not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:19.254188 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a883160d-7880-408a-8d86-7c33acef58b5 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:06:19.290414 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: a883160d-7880-408a-8d86-7c33acef58b5 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:06:19.290758 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device a883160d-7880-408a-8d86-7c33acef58b5 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:06:19.317419 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.321376 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-04c76c3a-6f9a-41b7-a652-8a438cf78d20 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:19.334582 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.345388 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Pushing event deleted for resources: {'Network': ['ID=93bb6fb9-a4aa-410c-ad6f-f2197fd69da3,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:19.348053 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:19.349850 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-7e16f847-0aa5-4e09-83b7-62a89ddfe286 admin admin] 10.222.0.81 "DELETE /v2.0/networks/93bb6fb9-a4aa-410c-ad6f-f2197fd69da3 HTTP/1.1" status: 204  len: 168 time: 1.1926045
May 26 15:06:19.646132 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36134) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:19.694082 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-96e5431c-1701-4737-ae3d-0ee37144985c admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=07c65d1e254f424ebfea8360aa697c34&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0467288
May 26 15:06:19.696966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36138) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:19.752697 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.778446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.918632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.922419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0d31275a-2104-4dff-853e-96d53e999ea4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:19.934921 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a611b0-6b0e-4059-8550-a67036619ed9,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:19.946733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.947103 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.947466 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.947824 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.948174 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.948524 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.948873 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.949219 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.949585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.949929 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.950272 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.950610 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:19.953864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:19.955010 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:19.956102 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-1b0e0d44-5c18-404d-b6a1-12d293e69133 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c2a611b0-6b0e-4059-8550-a67036619ed9 HTTP/1.1" status: 204  len: 168 time: 0.2582908
May 26 15:06:20.519000 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-44e58bc8-1dfe-4b9e-b3b4-9b0f3acfff59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:20.615860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36150) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:20.665271 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-81018b40-a13b-4ef6-aea8-ff42c48e39e1 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e45a0526c7fe43899d670e392bac47de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0481486
May 26 15:06:20.667601 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36154) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:20.725033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:20.750233 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:20.872856 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:20.877783 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-e69b1988-6ac1-43c1-9c6b-a051e977ddc9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:20.891100 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb3c3ed7-c943-4a76-b35f-84b2db22a6a5,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:20.893924 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:20.894853 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:20.895950 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-02878c26-8595-40a1-9a02-83c581a395a2 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fb3c3ed7-c943-4a76-b35f-84b2db22a6a5 HTTP/1.1" status: 204  len: 168 time: 0.2274580
May 26 15:06:23.107507 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:23.187573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-c3bbebfa-683f-4d5e-95f4-621919b5f682 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:24.067055 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:25.638843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:29.421570 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:30.719459 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36266) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:30.838560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:30.854816 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:06:30.858757 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Usage tracker for resource:security_group_rule and tenant:9e7bf35075104ff18c04a17bae8f42c0 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:06:30.861622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:06:30.867652 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:06:30.951543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.027450 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.036763 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-88dfd9c9-8123-47a8-8307-e63232bc59de admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:31.076063 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=9e7bf35075104ff18c04a17bae8f42c0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3555045
May 26 15:06:31.077018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f2e38e0-13d3-4699-949c-23d99d66f5d1,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:31.080208 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:31.080744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36280) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:31.144980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.171489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.296000 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.300875 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7fe1063f-d379-43af-a256-b09573e603f9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:31.314840 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f2e38e0-13d3-4699-949c-23d99d66f5d1,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:31.317777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:31.320597 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:31.321976 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/0f2e38e0-13d3-4699-949c-23d99d66f5d1 HTTP/1.1" status: 204  len: 168 time: 0.2399478
May 26 15:06:37.282865 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:06:41.408836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36460) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:41.528618 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:41.543206 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:06:41.547148 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Usage tracker for resource:security_group_rule and tenant:d24a0974dded4eefb5aeee5fd3123398 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:06:41.550014 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:06:41.555680 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:06:41.637432 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:41.718914 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:41.726186 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cbf5fdef-783c-4add-a60a-b0241f518658 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:41.769641 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a6d71bd-4ace-4e61-8262-bcf36c46de78,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:41.774075 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=d24a0974dded4eefb5aeee5fd3123398&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3638313
May 26 15:06:41.774940 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:41.776710 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36466) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:41.833720 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:41.860919 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:41.999027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.004037 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-dd705940-e425-49a4-a6e0-d28a82633bd5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:42.017643 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a6d71bd-4ace-4e61-8262-bcf36c46de78,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:42.023335 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:42.029414 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.032960 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-a9190e10-ef91-482f-a532-0ea6bfc4bac5 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/1a6d71bd-4ace-4e61-8262-bcf36c46de78 HTTP/1.1" status: 204  len: 168 time: 0.2529705
May 26 15:06:42.634949 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36476) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:42.652770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.666989 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:06:42.670831 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Usage tracker for resource:security_group_rule and tenant:2ee12a1b3a914f5ca2e23af4842950e8 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:06:42.673598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:06:42.679751 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:06:42.768076 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.837660 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.845535 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b52de871-d177-4812-adf1-005ca30496d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:42.885664 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b0858ca0-5479-4913-a7b2-94476ab35059,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:42.891036 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=2ee12a1b3a914f5ca2e23af4842950e8&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2550485
May 26 15:06:42.893816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36480) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:06:42.895886 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.896217 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.896591 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.897211 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.897589 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.898479 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.898836 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.899192 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.899549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.899902 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.900254 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.900603 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:06:42.904881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:42.952136 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:42.977588 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:43.102616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:43.106584 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2bcecbea-ffcc-4954-a62b-1440bff7a8da admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:06:43.126330 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b0858ca0-5479-4913-a7b2-94476ab35059,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:06:43.128366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:43.133298 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/b0858ca0-5479-4913-a7b2-94476ab35059 HTTP/1.1" status: 204  len: 168 time: 0.2383881
May 26 15:06:43.147313 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9491cb12-245b-43df-910b-c485cffbe764 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:06:50.495914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-8237cbf7-9ac3-42f1-b214-176a57ef9416 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:53.123871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:53.152302 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7cec564f-d38c-4064-b6b8-57f096daf72d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:54.082431 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:55.632885 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:06:59.461437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:14.281213 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:07:20.513214 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a0da86ab-7908-45c3-8232-2bc99b1b4b20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.034743 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36812) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:21.156610 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.170935 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:21.174736 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Usage tracker for resource:security_group_rule and tenant:ca3b95f801cb4d489cd7526afedd1cc9 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:21.177582 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:21.183300 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:21.266234 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.358497 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.367423 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ec490186-1b0c-4916-9787-49d63a954d17 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:21.407186 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=ca3b95f801cb4d489cd7526afedd1cc9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3713794
May 26 15:07:21.408999 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=556af99f-d146-46b8-b1b8-ef226f85c1f5,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:21.409886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36822) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:21.412492 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:21.477018 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.503775 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.642246 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.645995 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-84ccd258-1ba8-4e16-b04f-c48797c578a6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:21.657785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=556af99f-d146-46b8-b1b8-ef226f85c1f5,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:21.668076 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:21.669330 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/556af99f-d146-46b8-b1b8-ef226f85c1f5 HTTP/1.1" status: 204  len: 168 time: 0.2584233
May 26 15:07:21.670688 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.671110 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.671474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.671916 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.672270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.672633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.672986 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.673338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.673714 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.674068 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.674415 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.674758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:21.678366 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0923ec4d-5e8c-4e3c-9ed1-f4d6db28bc18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:22.820232 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36834) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:22.941770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:22.961619 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:22.966118 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Usage tracker for resource:security_group_rule and tenant:8ac8279a9e8344b6a4fc2272f285e40c is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:22.969082 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:22.974760 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:23.058294 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.106945 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.123937 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.131444 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6884024b-fc21-4696-a2e7-c69b0ae63d02 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:23.140965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-dc2841ee-e9c8-4772-8f70-7b4835b638de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.173436 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23ad7802-bdd8-4fd4-962d-0a86f29f058d,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:23.176391 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:23.178958 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-fc509ce7-9475-49a8-9082-f9e906ee7733 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=8ac8279a9e8344b6a4fc2272f285e40c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3577375
May 26 15:07:23.181698 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36840) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:23.239885 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.265655 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.402018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.406899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0759811e-4400-47bb-942d-f71639e91287 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:23.424646 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23ad7802-bdd8-4fd4-962d-0a86f29f058d,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:23.429192 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:23.435843 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:23.436952 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-04ea6415-9ebf-47d4-a5cf-b909331bb749 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/23ad7802-bdd8-4fd4-962d-0a86f29f058d HTTP/1.1" status: 204  len: 168 time: 0.2543201
May 26 15:07:24.025386 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36848) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:24.043433 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.057683 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:24.061704 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Usage tracker for resource:security_group_rule and tenant:e183f6c5c39340549053b88c3eea145e is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:24.064532 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:24.070194 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:24.076513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.150549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.224938 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.233485 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-2cacd774-f785-4cce-9290-107c6f28b8e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:24.273061 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=e183f6c5c39340549053b88c3eea145e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2466240
May 26 15:07:24.273968 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c5bb1ee6-f171-4bb7-be6f-2a788d1e4760,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:24.275855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36852) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:24.280154 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:24.335343 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.360637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.493827 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.498469 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41831263-9c18-4d50-9ca6-42a1abb4cb65 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:24.513388 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c5bb1ee6-f171-4bb7-be6f-2a788d1e4760,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:24.515792 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:24.520760 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:24.522195 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-2950080e-cf40-4f15-bc34-cd10984f3d39 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/c5bb1ee6-f171-4bb7-be6f-2a788d1e4760 HTTP/1.1" status: 204  len: 168 time: 0.2453156
May 26 15:07:25.648224 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:29.455839 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.426884 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36928) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:32.542772 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.557324 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:32.561848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Usage tracker for resource:security_group_rule and tenant:c9ed267387e34071b6a80af4a2dd3834 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:32.564614 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:32.570301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:32.651144 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.698812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.706835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-32ab3df0-93d1-4b8c-8170-fa2aef65620b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:32.747297 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=c9ed267387e34071b6a80af4a2dd3834&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3193736
May 26 15:07:32.748205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb124fdc-e531-4e27-8e7e-5a22bdf2e958,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:32.749992 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36934) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:32.751738 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:32.809486 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.838645 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.950872 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.955494 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-ddff6623-622f-4aed-922b-9b5a1ada8ea0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:32.968018 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb124fdc-e531-4e27-8e7e-5a22bdf2e958,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:32.972500 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:32.981985 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:32.983177 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-158205f4-ab37-47f2-9286-311c80435fe7 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/fb124fdc-e531-4e27-8e7e-5a22bdf2e958 HTTP/1.1" status: 204  len: 168 time: 0.2322085
May 26 15:07:33.507870 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 36942) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:33.526429 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.540646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:33.544488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Usage tracker for resource:security_group_rule and tenant:f550f48c5eb340a5adc23788370df40e is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:33.547353 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:33.553014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:33.640637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.684559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.692971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2c97b1b0-8dc7-4a37-97cd-fe6d9340f788 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:33.733349 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=f550f48c5eb340a5adc23788370df40e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2244353
May 26 15:07:33.734252 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=199d41e3-9d0f-4256-966e-147d418b6cd2,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:33.736142 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 36946) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:33.737219 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3ac26b3f-bd76-47a3-881f-4a2afc0ed6a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:33.804516 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.830126 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.962103 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.965705 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-b5e6920d-6a9a-4daf-986f-9db0acedeb98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:33.976439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=199d41e3-9d0f-4256-966e-147d418b6cd2,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:33.980200 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:33.983898 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:33.985006 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9eecd678-b7a3-4a46-89cd-ca20c68c0cc6 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/199d41e3-9d0f-4256-966e-147d418b6cd2 HTTP/1.1" status: 204  len: 168 time: 0.2478747
May 26 15:07:46.054651 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37046) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:46.170558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.188556 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:46.192339 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Usage tracker for resource:security_group_rule and tenant:848d82f0905940d6b6de477d349b2fe6 is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:46.195247 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:46.201868 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:46.282165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.352329 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.361304 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fa5889c7-35c7-4fb7-af87-a987ea673f6a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:46.400850 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=848d82f0905940d6b6de477d349b2fe6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3451583
May 26 15:07:46.401799 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23e173ee-8335-4949-a2b3-978188092047,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:46.403545 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37052) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:46.409912 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.410293 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.410664 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.411027 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.411388 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.411750 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.412107 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.412467 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.412820 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.413173 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.413549 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.413904 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:46.417787 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-3ac84b8e-2d0f-4961-9628-3f0dc77afa41 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:46.463221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.489846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.587013 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.590719 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4f03d531-2be9-42e0-baa9-661281fede09 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:46.605052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23e173ee-8335-4949-a2b3-978188092047,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:46.608273 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:46.617732 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:46.618857 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d38d3a7a-0ee3-475a-b8e0-7fa5ce662831 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/23e173ee-8335-4949-a2b3-978188092047 HTTP/1.1" status: 204  len: 168 time: 0.2137439
May 26 15:07:47.628274 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37076) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:47.733610 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-213529867-network', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:47.738292 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:47.742100 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Usage tracker for resource:network and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:47.744896 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:47.752040 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:47.832530 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Made reservation on behalf of 511d07599f124852b029e4bc01cbdd7f for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:07:47.834843 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:47.851563 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:47.866332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:47.870116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:47.873023 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:47.878713 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:47.962438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.049712 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.052672 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-383a4152-138a-4d83-94e7-9ec8526206d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:48.084094 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1246}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 15:07:48.089212 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e34e14e2-0f62-4f39-b660-0a89fe1a67c0,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:48.092902 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:48.096805 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.096805 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Added segment e920f375-6044-42b6-8e5d-20350794e774 of type vlan for network 8cb13f82-5501-498d-8d6a-19501eaaa488
May 26 15:07:48.121827 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.207507 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.209007 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:07:48.209812 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:48.214656 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fb8fc7d0-5829-4939-9b6b-3cb78a064555 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:48.313605 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Pushing event updated for resources: {'Network': ['ID=8cb13f82-5501-498d-8d6a-19501eaaa488,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:48.316325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:48.323719 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 15:07:48.376052 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-4124f8c7-58fa-48d3-8edb-e5c3d0010346 admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 0.7467155
May 26 15:07:48.378808 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37082) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:48.384163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Request body: {'subnet': {'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-213529867-subnet', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:48.389052 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:48.393051 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Usage tracker for resource:subnet and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:48.395881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:48.401956 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:48.478685 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Made reservation on behalf of 511d07599f124852b029e4bc01cbdd7f for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:07:48.480978 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.010865 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.015344 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:49.088202 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:49.092237 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:49.094804 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:49.095166 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Network hostable DHCP agents. Network: 8cb13f82-5501-498d-8d6a-19501eaaa488, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 15:07:49.180842 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 15:07:49.260736 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, 8cb13f82-5501-498d-8d6a-19501eaaa488) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:49.270841 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:07:49.276518 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.276653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a48058e-5f47-40ec-b2e8-cecf5418918b None None] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:07:49.364531 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-dcdd52d2-eb1c-49ff-819f-8fa0a893c597 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 0.9846735
May 26 15:07:49.367408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37086) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:49.372448 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:49.377743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:49.381569 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Usage tracker for resource:router and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:49.384425 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:49.391198 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:49.478303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.479374 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.486740 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-8cb13f82-5501-498d-8d6a-19501eaaa488', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 15:07:49.488827 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.493850 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.641653 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Allocated IP 172.20.0.2 (8cb13f82-5501-498d-8d6a-19501eaaa488/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6/b4222013-e6de-46e2-bd04-d31df642d3ad) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:07:49.828625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.846109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.855707 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Transition to ACTIVE for port object b4222013-e6de-46e2-bd04-d31df642d3ad will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:49.874308 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Transition to ACTIVE for port object b4222013-e6de-46e2-bd04-d31df642d3ad will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:49.936686 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:49.940566 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-f5dcb467-dede-4ea3-a654-32473003a87c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:50.007019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:50.009961 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:50.013923 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:07:50.019322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Pushing event updated for resources: {'Port': ['ID=b4222013-e6de-46e2-bd04-d31df642d3ad,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:50.056060 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.056401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.056730 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.057051 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.057372 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.057716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.058033 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.058348 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.058661 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.058970 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.059364 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.059689 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:50.067886 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:50.116608 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Attempting to bind port b4222013-e6de-46e2-bd04-d31df642d3ad on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:07:50.116917 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Attempting to bind port b4222013-e6de-46e2-bd04-d31df642d3ad by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:07:50.117294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Attempting to bind port b4222013-e6de-46e2-bd04-d31df642d3ad on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:07:50.122348 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:07:50.123412 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:50.123825 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.124328 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Bound using segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:07:50.124792 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Bound port: b4222013-e6de-46e2-bd04-d31df642d3ad, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:07:50.125164 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.214516 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] For port b4222013-e6de-46e2-bd04-d31df642d3ad, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:07:50.215302 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.218273 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] For port b4222013-e6de-46e2-bd04-d31df642d3ad, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=b4222013-e6de-46e2-bd04-d31df642d3ad,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:07:50.245604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.301973 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.306630 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:50.379913 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Allocated IP 172.27.2.95 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:07:50.393151 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Pushing event updated for resources: {'Port': ['ID=b4222013-e6de-46e2-bd04-d31df642d3ad,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:50.398810 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:50.501495 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-99e191f4-d897-4750-be78-5a07c21acbd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.535140 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.627508 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:50.632400 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ee211eed-e897-4336-ab5e-6989f6f0e97b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:50.698855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:50.701803 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:50.704255 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:07:50.839677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Pushing event updated for resources: {'Port': ['ID=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:50.848542 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:51.281121 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:07:51.287378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:51.296120 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f3bb3cc-df38-4b7a-830b-b15c05ff2b21 None None] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:07:51.320354 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device b4222013-e6de-46e2-bd04-d31df642d3ad up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:51.542391 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-bf2200f6-b641-49a0-8aef-216f675a9997 None None] Provisioning for port b4222013-e6de-46e2-bd04-d31df642d3ad completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:51.605241 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port b4222013-e6de-46e2-bd04-d31df642d3ad completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:51.617010 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port b4222013-e6de-46e2-bd04-d31df642d3ad triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:51.617385 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:51.667501 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:51.756478 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:51.793568 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port b4222013-e6de-46e2-bd04-d31df642d3ad, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=b4222013-e6de-46e2-bd04-d31df642d3ad,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:07:51.859278 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:51.861160 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a57f7dde-fa1d-425c-93ad-61964b0c117d None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:51.928181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=b4222013-e6de-46e2-bd04-d31df642d3ad,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:51.931239 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:51.939107 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 15:07:51.978974 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f0481d4b-f509-4031-87be-a10234e4b692 None None] Provisioning complete for port b4222013-e6de-46e2-bd04-d31df642d3ad triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:51.979263 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f0481d4b-f509-4031-87be-a10234e4b692 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:52.120733 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:07:52.129156 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:07:52.138785 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:07:52.139490 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac405cbe0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:52.221139 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:52.222850 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 2.8543379
May 26 15:07:52.225932 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37090) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:52.313718 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:07:52.612387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac405cbe0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:51Z', 'revision_number': 3, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:50Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:52.616161 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:07:52.616509 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Updating router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:07:52.667128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:52.985883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:52.996733 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Transition to ACTIVE for port object f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:53.015572 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.094882 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.101219 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:53.150303 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.186642 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Attempting to bind port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:07:53.187009 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Attempting to bind port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:07:53.187369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Attempting to bind port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:07:53.190705 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Pushing event updated for resources: {'Port': ['ID=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:53.194569 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:53.195458 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:07:53.197835 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:53.197835 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.197835 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:07:53.197835 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Bound port: f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:07:53.197835 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.229203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Allocated IP 172.20.0.1 (8cb13f82-5501-498d-8d6a-19501eaaa488/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6/d89827f6-2ccb-4bd9-a079-83aff0cb1f5e) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:07:53.231815 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-38634d3d-bae9-4f6a-b971-4f54d184967b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.272248 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] For port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:07:53.275176 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] For port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:07:53.284398 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device b4222013-e6de-46e2-bd04-d31df642d3ad up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:53.354425 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.365302 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-74d3bba2-8988-4301-8b30-48a74b1b5a2b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:53.381475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.396757 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Transition to ACTIVE for port object d89827f6-2ccb-4bd9-a079-83aff0cb1f5e will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:53.461186 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:07:53.461830 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac405cbe0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:53.462030 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.467301 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:53.517644 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Pushing event updated for resources: {'Port': ['ID=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:53.528645 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:53.531632 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:53.534441 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:53.536795 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:07:53.548755 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port b4222013-e6de-46e2-bd04-d31df642d3ad triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:53.549130 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.582446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Pushing event updated for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:53.585356 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:53.601453 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.709090 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:07:53.938239 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:53.944353 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-4ebaf02b-1e55-4312-8004-703af62878bc None None] Provisioning for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:53.953565 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-4ebaf02b-1e55-4312-8004-703af62878bc None None] Provisioning complete for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:53.953943 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4ebaf02b-1e55-4312-8004-703af62878bc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.047164 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-4ebaf02b-1e55-4312-8004-703af62878bc None None] Port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:07:54.118529 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac405cbe0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:51Z', 'revision_number': 3, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:54.123346 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-105c3c0a-85ed-414c-a1a1-05a3fc2078c0 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:51Z', 'revision_number': 3, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:07:54.152786 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.275302 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.335262 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.363070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f137a770-5947-4f35-92a6-db48782ae399 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:54.452710 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.456378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Pushing event updated for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:54.462013 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:54.599348 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:54.600586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:54.798660 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:07:54.871547 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f0120a73-f6dd-4418-9985-5f3ab82efd26 None None] Provisioning complete for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:54.872060 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f0120a73-f6dd-4418-9985-5f3ab82efd26 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:54.925952 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-f0120a73-f6dd-4418-9985-5f3ab82efd26 None None] Port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:07:54.983277 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:07:54.991989 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-6bf26549-72e2-4b97-b78f-559c6d18a949 admin admin] 10.222.0.81 "PUT /v2.0/routers/adc8aa9d-fb80-48f3-8d70-86ae33a2c804/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7650909
May 26 15:07:55.291247 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:55.432986 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:55.439649 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:55.444180 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.567709 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:07:55.577156 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.577727 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:07:55.578571 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05160>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:55.598719 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:07:55.655707 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.670457 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.672650 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:55.685940 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37108) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:55.691837 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-76928611-network', 'tenant_id': 'a056c271765b428094429bd897256335'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:55.696953 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:55.701428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Usage tracker for resource:network and tenant:a056c271765b428094429bd897256335 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:55.705010 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:55.712673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:55.750759 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:55.754007 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:55.757948 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:07:55.779262 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Made reservation on behalf of a056c271765b428094429bd897256335 for: {'network': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:07:55.782216 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770338'] for network, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.798939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.816364 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:55.817673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Usage tracker for resource:security_group_rule and tenant:a056c271765b428094429bd897256335 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:55.820547 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:55.827485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:55.916018 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.978967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:55.983885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-cfdd340b-2946-4539-ac87-f65ad86138ba tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:56.008484 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1210}  {{(pid=103982) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 26 15:07:56.021600 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a91c68f0-9068-43de-a053-21556761fa0c,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:56.025387 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:56.028365 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.028740 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.segments_db [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Added segment 20f963c6-ff4c-42b9-82bd-54a12175ca4f of type vlan for network dd7efba7-2f11-4123-a08a-0654f156b0cb
May 26 15:07:56.056288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8781805042252'] for network, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.106303 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05160>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:07:54Z', 'revision_number': 2, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:56.110731 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:07:56.111124 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Updating router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:07:56.129776 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058'] for network, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.131145 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:07:56.131728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.136615 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:56.164109 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.236860 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Pushing event updated for resources: {'Network': ['ID=dd7efba7-2f11-4123-a08a-0654f156b0cb,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:56.239546 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:56.246573 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Network dd7efba7-2f11-4123-a08a-0654f156b0cb details requested by agent ovs-agent-dv-cinder-784140-4-iscsi with host dv-cinder-784140-4-iscsi {{(pid=103983) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 26 15:07:56.290748 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-fec2e47f-e02b-4fb6-9a34-5506d4b1972a admin admin] 10.222.0.81 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.6026134
May 26 15:07:56.290993 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37112) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:56.298329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Request body: {'subnet': {'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-76928611-subnet', 'tenant_id': 'a056c271765b428094429bd897256335', 'ip_version': 4}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:56.303096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:56.307308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Usage tracker for resource:subnet and tenant:a056c271765b428094429bd897256335 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:56.311318 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:56.317499 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:56.415286 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Made reservation on behalf of a056c271765b428094429bd897256335 for: {'subnet': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:07:56.417792 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2650473'] for subnet, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.524279 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.536187 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Transition to ACTIVE for port object d89827f6-2ccb-4bd9-a079-83aff0cb1f5e will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:56.624957 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.629746 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:56.755482 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Pushing event updated for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:56.764418 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.764786 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.765125 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.765451 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.765814 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.766120 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.766439 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.766759 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.767080 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.767396 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.767707 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.768017 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103984) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:07:56.771989 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:56.862673 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Attempting to bind port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:07:56.863048 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Attempting to bind port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:07:56.863410 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Attempting to bind port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:07:56.869414 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:07:56.869825 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:56.870231 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.870618 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Bound using segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:07:56.871083 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Bound port: d89827f6-2ccb-4bd9-a079-83aff0cb1f5e, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:07:56.871462 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.889843 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2528453', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2650495'] for subnet, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:56.894187 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-843f6bb3-d6e5-4759-8459-5f1096cced95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:56.962132 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] For port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:07:56.965178 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] For port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:07:56.967603 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d2eed12b-1853-43c6-9d27-5589deb4b611,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:56.971109 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:56.973634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Checking segment: {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:56.973917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Network hostable DHCP agents. Network: dd7efba7-2f11-4123-a08a-0654f156b0cb, hostable agents: ['b768140a-519b-47d0-aec2-e775d4e92dc4'], hosted agents: [] {{(pid=103982) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 26 15:07:57.053923 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.057872 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:57.072331 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Network dd7efba7-2f11-4123-a08a-0654f156b0cb is scheduled to be hosted by DHCP agent b768140a-519b-47d0-aec2-e775d4e92dc4 with binding_index 1 {{(pid=103982) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 26 15:07:57.130136 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:07:57.130766 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05160>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:57.139509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-784140-4-iscsi, dd7efba7-2f11-4123-a08a-0654f156b0cb) {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:57.149881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:07:57.149881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for subnet, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.151104 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd939bb0-bed8-488b-961f-1579ad2a540d None None] Network dd7efba7-2f11-4123-a08a-0654f156b0cb requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:07:57.197489 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Pushing event updated for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:57.224271 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:57.234452 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bbca4506-c772-49a0-9974-49753d17e0b7 admin admin] 10.222.0.81 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.9395804
May 26 15:07:57.234656 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37116) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:07:57.239806 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:07:57.245222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:07:57.250727 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Usage tracker for resource:router and tenant:a056c271765b428094429bd897256335 is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:07:57.253933 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:07:57.260527 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:07:57.288947 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:57.343075 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:07:57.352767 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3921319', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-684'] for router, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.353846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3920039', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3927663', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3866297', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-679'] for router, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.368989 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.531035 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:57.531415 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.556810 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpb8e6c822-e692-51a5-8fd4-5532d2cec7fd-dd7efba7-2f11-4123-a08a-0654f156b0cb', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611'}]}} from dv-cinder-784140-4-iscsi. {{(pid=103983) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 26 15:07:57.557677 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:57.691395 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05160>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:07:56Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:07:57.695434 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-77738497-32ea-4787-bb22-815d54470ef8 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:07:56Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:07:57.812795 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.db_base_plugin_common [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Allocated IP 172.20.0.2 (dd7efba7-2f11-4123-a08a-0654f156b0cb/d2eed12b-1853-43c6-9d27-5589deb4b611/d13655ab-e6e9-4827-97a7-ef32fbf2ad7a) {{(pid=103983) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:07:57.841917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3927672', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3921337', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-721'] for router, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.044166 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks [] for port, precommit_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.059559 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Transition to ACTIVE for port object d13655ab-e6e9-4827-97a7-ef32fbf2ad7a will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:58.086382 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Transition to ACTIVE for port object d13655ab-e6e9-4827-97a7-ef32fbf2ad7a will not be triggered until provisioned by entity DHCP. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:07:58.176154 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651'] for port, after_create {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.180091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1fcf08c5-58b4-4386-8cab-1f45a62c4458 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:58.253843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Network dd7efba7-2f11-4123-a08a-0654f156b0cb is already hosted by enough agents. {{(pid=103983) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:58.256703 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.scheduler.base_scheduler [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Resources bound (agent type, host, resource id):  {{(pid=103983) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:58.258575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.260800 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Received port after_create {{(pid=103983) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:07:58.270302 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Pushing event updated for resources: {'Port': ['ID=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,revision_number=1']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:58.290860 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.302802 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:58.369004 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Attempting to bind port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:07:58.369396 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Attempting to bind port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:07:58.369761 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Attempting to bind port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a on network dd7efba7-2f11-4123-a08a-0654f156b0cb {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:07:58.376053 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:07:58.376437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Checking segment: {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:07:58.376889 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.377450 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Bound using segment: {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:07:58.381708 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Bound port: d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:07:58.381708 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.447954 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Allocated IP 172.27.2.209 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/f9069e38-40c4-4080-b706-fa8d55e31a42) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:07:58.474105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] For port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:07:58.477318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] For port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:07:58.530780 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.539977 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:58.609747 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.619313 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Pushing event updated for resources: {'Port': ['ID=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:58.623076 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:58.703251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:58.708299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef7193da-607f-4afa-a900-b7496c0e6f7f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:07:58.789304 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:07:58.791623 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:07:58.795498 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:07:58.835556 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Pushing event updated for resources: {'Port': ['ID=f9069e38-40c4-4080-b706-fa8d55e31a42,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:07:58.849156 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:07:59.337477 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d13655ab-e6e9-4827-97a7-ef32fbf2ad7a up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:59.427278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:59.466919 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:59.499504 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:59.504922 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d89827f6-2ccb-4bd9-a079-83aff0cb1f5e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:07:59.535025 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e1174e5f-24cb-4659-b6a2-9f5ebd1abeb9 None None] Network dd7efba7-2f11-4123-a08a-0654f156b0cb requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:07:59.735291 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Provisioning for port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:59.743172 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Provisioning complete for port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:59.743544 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:59.783468 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:07:59.784939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3921328', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3927561'] for router, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:07:59.827739 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:07:59.828116 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.030357 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.065340 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.093721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Router 2506d6c8-57be-4964-b8b4-1b44199bde3a is scheduled to L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea with binding_index 1 {{(pid=103982) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 26 15:08:00.098493 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] For port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:00.111719 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:00.173567 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.176321 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:00.211375 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.246668 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Pushing event updated for resources: {'Port': ['ID=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:00.249724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:00.250390 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.029s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:00.283586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:08:00.339716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Sync routers for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:08:00.367474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.368725 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] 10.222.0.81 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 3.1331205
May 26 15:08:00.369572 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:00.370204 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac464ba60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:00.371379 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37120) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:00.426063 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-d5e3f837-a896-4794-8c90-fda53e25bdaf None None] Provisioning complete for port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:00.426440 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-d5e3f837-a896-4794-8c90-fda53e25bdaf None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:00.494581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:00.497892 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.247s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:00.637558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:00.951161 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac464ba60>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:07:59Z', 'revision_number': 3, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:07:58Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:00.954971 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Checking router: 2506d6c8-57be-4964-b8b4-1b44199bde3a for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:08:00.955322 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Updating router 2506d6c8-57be-4964-b8b4-1b44199bde3a port f9069e38-40c4-4080-b706-fa8d55e31a42 binding host dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:08:01.007021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.157695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.303801 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d13655ab-e6e9-4827-97a7-ef32fbf2ad7a up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:01.363734 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Allocated IP 172.20.0.1 (dd7efba7-2f11-4123-a08a-0654f156b0cb/d2eed12b-1853-43c6-9d27-5589deb4b611/1dc71af4-d0ae-4a21-9090-cb285bf6cd6b) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:08:01.383924 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks [] for port, precommit_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.399536 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Transition to ACTIVE for port object f9069e38-40c4-4080-b706-fa8d55e31a42 will not be triggered until provisioned by entity L2. {{(pid=103983) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:08:01.413393 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:01.413735 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.505402 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.518627 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7bf78603-f80c-47f4-a23b-c7a642596f7e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:01.539219 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.555451 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Transition to ACTIVE for port object 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:08:01.601638 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d89827f6-2ccb-4bd9-a079-83aff0cb1f5e up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:01.635163 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Attempting to bind port f9069e38-40c4-4080-b706-fa8d55e31a42 on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:08:01.635533 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Attempting to bind port f9069e38-40c4-4080-b706-fa8d55e31a42 by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:08:01.635901 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Attempting to bind port f9069e38-40c4-4080-b706-fa8d55e31a42 on network 0090f6f3-94b8-4606-8d1e-abbe36685c7a {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:08:01.647909 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.649910 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80184636-c569-4fba-aeee-6f4a85f8a204 None None] Pushing event updated for resources: {'Port': ['ID=f9069e38-40c4-4080-b706-fa8d55e31a42,revision_number=2']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:01.652743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-b746f137-ed51-4470-a813-7924872c25ac tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:01.658793 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:08:01.659175 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Checking segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103983) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:08:01.659588 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.659979 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Bound using segment: {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'} {{(pid=103983) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:08:01.660467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.managers [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Bound port: f9069e38-40c4-4080-b706-fa8d55e31a42, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3911e6c6-a3f2-4d55-9830-82a3b81724ae', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a'}}] {{(pid=103983) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:08:01.660850 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.694307 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-80184636-c569-4fba-aeee-6f4a85f8a204 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:01.719653 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Network dd7efba7-2f11-4123-a08a-0654f156b0cb is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:08:01.722657 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:08:01.726287 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:08:01.751850 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] For port f9069e38-40c4-4080-b706-fa8d55e31a42, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103983) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:08:01.757298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] For port f9069e38-40c4-4080-b706-fa8d55e31a42, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f9069e38-40c4-4080-b706-fa8d55e31a42,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:08:01.759889 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Pushing event updated for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:01.761268 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:01.761268 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.769399 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:01.788835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3930735'] for router_interface, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.878568 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:01.929245 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-7119efcc-0524-4fc2-a1fb-da339fc507c3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:01.992015 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.027575 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:02.028181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac464ba60>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:02.091809 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-9f3f5be4-8237-4474-addd-94bdcd39f764 None None] Provisioning for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:08:02.107398 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80184636-c569-4fba-aeee-6f4a85f8a204 None None] Pushing event updated for resources: {'Port': ['ID=f9069e38-40c4-4080-b706-fa8d55e31a42,revision_number=3']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:02.113295 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-80184636-c569-4fba-aeee-6f4a85f8a204 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:02.113871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-9f3f5be4-8237-4474-addd-94bdcd39f764 None None] Provisioning complete for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:02.114239 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-9f3f5be4-8237-4474-addd-94bdcd39f764 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.225443 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.244206 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-9f3f5be4-8237-4474-addd-94bdcd39f764 None None] Port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:08:02.264209 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:02.287652 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.317522 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8e2c5fd8-5848-4899-ab64-c934cb536ff2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:02.404777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Pushing event updated for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:02.407675 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:02.408858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3801072', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3930828'] for router_interface, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.549479 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Network dd7efba7-2f11-4123-a08a-0654f156b0cb is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:08:02.550634 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:08:02.578353 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac464ba60>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '1dc71af4-d0ae-4a21-9090-cb285bf6cd6b', 'name': '', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'mac_address': 'fa:16:3e:d2:a3:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:08:01Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 1, 'project_id': 'a056c271765b428094429bd897256335', 'subnets': [{'id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:02.582615 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-82040035-4717-44c1-9aa5-ec9c730c61c4 None None] The sync data for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi is: [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '1dc71af4-d0ae-4a21-9090-cb285bf6cd6b', 'name': '', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'mac_address': 'fa:16:3e:d2:a3:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:08:01Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 1, 'project_id': 'a056c271765b428094429bd897256335', 'subnets': [{'id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:08:02.756748 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Router 2506d6c8-57be-4964-b8b4-1b44199bde3a has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:08:02.767498 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7c95a7ed-63cf-43f6-acf6-cd60963dc948 None None] Provisioning complete for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:02.768049 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7c95a7ed-63cf-43f6-acf6-cd60963dc948 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:02.856843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-7c95a7ed-63cf-43f6-acf6-cd60963dc948 None None] Port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:08:03.061730 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:08:03.070930 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] 10.222.0.81 "PUT /v2.0/routers/2506d6c8-57be-4964-b8b4-1b44199bde3a/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6983678
May 26 15:08:03.712317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37130) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:03.718300 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-675203712', 'description': 'tempest-secgroup-smoke-675203712 description', 'project_id': '511d07599f124852b029e4bc01cbdd7f'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:03.724307 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:03.728114 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:03.731014 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:03.737447 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:03.801891 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:03.823948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:03.828403 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:03.831299 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:03.836975 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:03.905338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:03.967495 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:03.971256 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-29ce2004-f9a1-4700-9633-9856a9ac055d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:04.011127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1c3a2647-9496-45b8-89c8-8ccb8faa8126,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:04.014533 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:04.087917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.089470 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-3d7ace10-de8a-4b2b-a446-676449dd177d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1792 time: 0.3761311
May 26 15:08:04.092661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37134) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:04.097932 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:04.104036 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:04.108703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:04.111590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:04.117232 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:04.195952 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.262478 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.333527 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.336944 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:04.359704 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f02b77b9-a8d7-4ab6-b867-3e6d5a205fd7,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:04.362278 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:04.442142 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.443577 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-f8aff7da-93f8-4e06-ac72-0b69ce1a04b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3499885
May 26 15:08:04.446372 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37138) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:04.451774 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:04.463471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:04.463471 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:04.466646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:04.472873 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:04.540085 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.607243 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.661616 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.663744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-56d2f332-a785-4c60-9ca9-4a34dab1b023 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:04.687264 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=31d2732a-f0b7-4a2c-9826-2475d2e91e60,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:04.689818 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:04.779966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.781486 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-86e0cf38-d2d2-459b-b711-178b55099157 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3340952
May 26 15:08:04.784299 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37142) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:04.790601 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:04.797493 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:04.801808 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:04.804773 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:04.812678 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:04.896051 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:04.957077 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.047695 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.054000 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-fbd55b30-c30c-4380-be0f-3716004775b2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:05.072769 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ca5d5c8e-2616-42b9-b0c9-7152f07711b4,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:05.075796 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:05.178899 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.180136 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3943338
May 26 15:08:05.182811 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37146) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:05.188356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:05.194274 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:05.199440 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:05.201649 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:05.207424 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:05.287826 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.309315 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f9069e38-40c4-4080-b706-fa8d55e31a42 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:05.359084 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.444021 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.452187 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-a9e265ec-e0b9-4678-b1b9-764d7d722edb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:05.470452 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port f9069e38-40c4-4080-b706-fa8d55e31a42 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:08:05.471033 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=627329dd-e779-449a-acb6-2b8aacce32b5,revision_number=0']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:05.476364 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port f9069e38-40c4-4080-b706-fa8d55e31a42 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:05.476616 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:05.480785 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.556241 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.559160 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Sync routers for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:08:05.561155 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37150) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:05.563974 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-f32fa991-9d98-4766-8c89-946db8c590fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.3801854
May 26 15:08:05.568059 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:05.569000 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:05.569675 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05c10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:05.584429 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:05.589094 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:05.593237 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:05.599554 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:05.611490 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.627609 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port f9069e38-40c4-4080-b706-fa8d55e31a42, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f9069e38-40c4-4080-b706-fa8d55e31a42,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:05.687706 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.securitygroups_db [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Project 511d07599f124852b029e4bc01cbdd7f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:08:05.694593 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.718736 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.720834 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:05.763962 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.779999 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:05.790032 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=f9069e38-40c4-4080-b706-fa8d55e31a42,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:05.793019 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:05.838361 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.846227 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:05.870494 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=86fdc71d-4860-4f50-8cb1-81f21cb33f6f,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:05.870893 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:05.981408 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:05.983247 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9d533ff7-9e11-4dd1-8a1d-d0093cb93505 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.4211068
May 26 15:08:05.986270 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37154) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:05.991895 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'security_group_rule': {'security_group_id': '1c3a2647-9496-45b8-89c8-8ccb8faa8126', 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:05.997953 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:06.001880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:security_group_rule and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:06.004758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:06.010672 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:06.099266 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05c10>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '1dc71af4-d0ae-4a21-9090-cb285bf6cd6b', 'name': '', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'mac_address': 'fa:16:3e:d2:a3:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:08:01Z', 'updated_at': '2021-05-26T15:08:02Z', 'revision_number': 2, 'project_id': 'a056c271765b428094429bd897256335', 'subnets': [{'id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:06.102922 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Checking router: 2506d6c8-57be-4964-b8b4-1b44199bde3a for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:08:06.103274 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Updating router 2506d6c8-57be-4964-b8b4-1b44199bde3a port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b binding host dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 26 15:08:06.107376 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.securitygroups_db [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Project 511d07599f124852b029e4bc01cbdd7f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 26 15:08:06.113327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.158058 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.180441 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.241861 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001724'] for security_group_rule, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.247948 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-4f15cb61-9624-4e2b-9edf-022ae2a4fc89 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:06.266906 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=14966e1f-fb29-4085-9c7a-0195dc0832ca,revision_number=0']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:06.269222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:06.335377 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group_rule, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.339604 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bf36a892-af5b-4526-af21-5e3fb50308ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.3493054
May 26 15:08:06.505533 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks [] for port, precommit_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.517157 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.provisioning_blocks [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Transition to ACTIVE for port object 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b will not be triggered until provisioned by entity L2. {{(pid=103984) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:08:06.636349 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.640877 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-2023d253-1011-4d9a-96a2-e8d804f182e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:06.763399 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dd8bb9d-5ae0-4c6b-97c8-871e578eaaeb None None] Pushing event updated for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=3']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:06.797451 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-3dd8bb9d-5ae0-4c6b-97c8-871e578eaaeb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:06.855390 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Attempting to bind port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b on host dv-cinder-784140-4-iscsi for vnic_type normal with profile  {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:08:06.855804 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Attempting to bind port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b by drivers openvswitch,hyperv on host dv-cinder-784140-4-iscsi at level 0 using segments [{'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:08:06.856162 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Attempting to bind port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b on network dd7efba7-2f11-4123-a08a-0654f156b0cb {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:08:06.861790 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Checking agent: {'id': '6010685b-8a73-47d4-ba7c-ee564bceaa4b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-784140-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 49, 53), 'started_at': datetime.datetime(2021, 5, 26, 14, 50, 23), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 7, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-784140-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:08:06.862218 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Checking segment: {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103984) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:08:06.862611 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.862992 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Bound using segment: {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'} {{(pid=103984) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:08:06.863442 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.managers [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Bound port: 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b, host: dv-cinder-784140-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '20f963c6-ff4c-42b9-82bd-54a12175ca4f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1210, 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb'}}] {{(pid=103984) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:08:06.863804 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:06.953774 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] For port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b, host dv-cinder-784140-4-iscsi, cleared binding levels {{(pid=103984) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:08:06.956774 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.plugins.ml2.db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] For port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b, host dv-cinder-784140-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103984) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:08:07.050017 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron_lib.callbacks.manager [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103984) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:07.054121 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-144f3506-a9f0-44ae-8358-c380a1ad68f5 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:07.128158 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:07.128779 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05c10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:07:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:07.193026 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dd8bb9d-5ae0-4c6b-97c8-871e578eaaeb None None] Pushing event updated for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=4']} {{(pid=103984) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:07.197846 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG oslo_concurrency.lockutils [None req-3dd8bb9d-5ae0-4c6b-97c8-871e578eaaeb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=103984) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:07.358093 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:07.379782 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f9069e38-40c4-4080-b706-fa8d55e31a42 up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:07.452913 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port f9069e38-40c4-4080-b706-fa8d55e31a42 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:07.453317 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:07.579411 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:07.686197 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4b05c10>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '1dc71af4-d0ae-4a21-9090-cb285bf6cd6b', 'name': '', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'mac_address': 'fa:16:3e:d2:a3:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:08:01Z', 'updated_at': '2021-05-26T15:08:06Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'subnets': [{'id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:07.690096 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1e70639-a98e-434a-855f-c6e0785abafb None None] The sync data for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi is: [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:08:01Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': '1dc71af4-d0ae-4a21-9090-cb285bf6cd6b', 'name': '', 'network_id': 'dd7efba7-2f11-4123-a08a-0654f156b0cb', 'tenant_id': 'a056c271765b428094429bd897256335', 'mac_address': 'fa:16:3e:d2:a3:2e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_interface', 'standard_attr_id': 669, 'fixed_ips': [{'subnet_id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:08:01Z', 'updated_at': '2021-05-26T15:08:06Z', 'revision_number': 4, 'project_id': 'a056c271765b428094429bd897256335', 'subnets': [{'id': 'd2eed12b-1853-43c6-9d27-5589deb4b611', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:08:07.701876 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:08:07.713402 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:07.715569 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:07.843260 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:07.886220 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] For port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:07.950647 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:07.954091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:08.024538 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Pushing event updated for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:08.027772 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:09.279542 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b up at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:09.384916 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Provisioning complete for port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:09.385294 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:20.510346 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-17b85a87-9ed6-49b4-b279-c8b0d50a6e29 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:23.146913 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:23.175179 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-6e288554-329d-462a-8724-eb13f3f98be8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:24.072600 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:24.172393 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-f77a7309-8dee-4f74-a8f0-20f050115ad2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-675203712&fields=id&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 267 time: 0.0404112
May 26 15:08:24.401685 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-eadca09b-e0bb-4b5d-8c61-88cffbcf4b57 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:24.403118 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-eadca09b-e0bb-4b5d-8c61-88cffbcf4b57 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.2242439
May 26 15:08:24.417524 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-42fab3d5-0977-41a7-b4d5-e5153d2f8ebe tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/quotas/511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 375 time: 0.0087130
May 26 15:08:24.498737 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-43c6be46-202a-4a9c-8eef-62d8a30cff09 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0764718
May 26 15:08:24.612642 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-84a39260-e6c0-4bd4-91ef-1d5c27c6d1ab service neutron] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103981) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 15:08:24.613790 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-84a39260-e6c0-4bd4-91ef-1d5c27c6d1ab service neutron] 10.222.0.81 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1034374
May 26 15:08:24.744864 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-ae582f50-1afd-4190-a963-8ec583978eec service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1251435
May 26 15:08:24.875747 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-452bfe8c-cd30-499a-97d9-85b4d25095b7 service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1249895
May 26 15:08:25.610449 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca req-117a8db6-fd79-411c-a3c2-1582868b085a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:08:25.689743 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:25.717803 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca req-117a8db6-fd79-411c-a3c2-1582868b085a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:08:25.719078 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca req-117a8db6-fd79-411c-a3c2-1582868b085a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 210 time: 0.2081325
May 26 15:08:26.876999 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-237f1ca1-dd14-443a-aa0b-add01298c6dc req-788bd380-1337-40b4-96f8-f56dc064d62b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 210 time: 0.0467565
May 26 15:08:27.978472 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-1c45aaf6-2e20-4a53-9a7e-dd3319a2b7ef tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:27.979225 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-1c45aaf6-2e20-4a53-9a7e-dd3319a2b7ef tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:network {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:08:28.040441 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-240d3e83-9ccb-4018-bcda-6650266b1da1 req-2c72cc59-e848-4bc2-a12b-aeb9de10f092 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 210 time: 0.0530417
May 26 15:08:28.121825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-1c45aaf6-2e20-4a53-9a7e-dd3319a2b7ef tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:network {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:08:28.122968 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-1c45aaf6-2e20-4a53-9a7e-dd3319a2b7ef tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.3004510
May 26 15:08:28.172279 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-dd11a76f-f51d-4ae4-b4e2-64519997b459 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:security_group {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:08:28.247479 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-dd11a76f-f51d-4ae4-b4e2-64519997b459 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:security_group {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:08:28.248741 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-dd11a76f-f51d-4ae4-b4e2-64519997b459 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 379 time: 0.1177015
May 26 15:08:28.257609 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'port': {'device_id': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'admin_state_up': True, 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'security_groups': ['1c3a2647-9496-45b8-89c8-8ccb8faa8126']}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:28.279652 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:08:28.398150 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:28.407604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:28.498820 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Made reservation on behalf of 511d07599f124852b029e4bc01cbdd7f for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:08:28.503217 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:28.667191 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.20.0.10 (8cb13f82-5501-498d-8d6a-19501eaaa488/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6/8a04a399-0467-4790-95e0-0eafe7abfa35) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:08:28.858303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:28.873879 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Transition to ACTIVE for port object 8a04a399-0467-4790-95e0-0eafe7abfa35 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:08:28.958819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:28.964832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:29.029591 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:08:29.032575 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:08:29.036551 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:08:29.083947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:29.102679 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.103109 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.103473 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.103837 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.104197 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.104559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.104919 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.105274 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.105658 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.106012 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.106362 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.106980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:08:29.110881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:29.132719 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:29.133338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.227575 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9737961
May 26 15:08:29.239264 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4ea414-362a-4337-8aef-28366246911d req-3812a62c-5c40-4442-ab12-8e4e8744f3e0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:29.239264 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7c4ea414-362a-4337-8aef-28366246911d req-3812a62c-5c40-4442-ab12-8e4e8744f3e0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 932 time: 0.0834787
May 26 15:08:29.241892 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-5fe7111b-45b6-484c-bf0c-a578f3b14133 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] http://10.222.0.81:9696/v2.0/extensions returned with HTTP 200 {{(pid=103982) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 26 15:08:29.242858 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-5fe7111b-45b6-484c-bf0c-a578f3b14133 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0053146
May 26 15:08:29.286490 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7c4ea414-362a-4337-8aef-28366246911d req-38216c4d-0d59-4aed-95e4-d76f45403ec2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0444028
May 26 15:08:29.313846 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Request body: {'port': {'device_id': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:29.367489 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f553baa3-1655-4f3e-9ae6-0d09f9e80347 None None] Provisioning for port 8a04a399-0467-4790-95e0-0eafe7abfa35 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:08:29.381965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-f553baa3-1655-4f3e-9ae6-0d09f9e80347 None None] Provisioning complete for port 8a04a399-0467-4790-95e0-0eafe7abfa35 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:29.382331 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f553baa3-1655-4f3e-9ae6-0d09f9e80347 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.429604 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.440181 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-f553baa3-1655-4f3e-9ae6-0d09f9e80347 None None] Port 8a04a399-0467-4790-95e0-0eafe7abfa35 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:08:29.501486 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.867316 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8a04a399-0467-4790-95e0-0eafe7abfa35 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:08:29.874446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.888363 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Transition to ACTIVE for port object 8a04a399-0467-4790-95e0-0eafe7abfa35 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:08:29.946184 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:29.949855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ef9319f6-f5b6-42cd-b8b8-36ec02d53fe1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:30.128876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Pushing event updated for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:30.136283 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.186s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:30.211329 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Attempting to bind port 8a04a399-0467-4790-95e0-0eafe7abfa35 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:08:30.211655 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Attempting to bind port 8a04a399-0467-4790-95e0-0eafe7abfa35 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:08:30.211976 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Attempting to bind port 8a04a399-0467-4790-95e0-0eafe7abfa35 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:08:30.216517 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Port 8a04a399-0467-4790-95e0-0eafe7abfa35 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:08:30.216832 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Attempting to bind port 8a04a399-0467-4790-95e0-0eafe7abfa35 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:08:30.222082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 8, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:08:30.222413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:08:30.222788 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Bound using segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:08:30.223203 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Bound port: 8a04a399-0467-4790-95e0-0eafe7abfa35, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:08:30.223542 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:30.310402 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:08:30.313917 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=8a04a399-0467-4790-95e0-0eafe7abfa35,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:08:30.436428 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:30.445925 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0b0c5b72-3067-438f-b205-9cbd64064eb6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:30.513964 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:30.514581 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:30.516141 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-22606d69-c846-42e7-9742-4a0275792467 service neutron] 10.222.0.32 "PUT /v2.0/ports/8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 200  len: 1094 time: 1.2664509
May 26 15:08:30.516674 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:08:30.542798 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Pushing event updated for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:30.550071 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:30.565172 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87747d65-ddfc-4750-bc44-40c6df50bd52 req-d8c0719b-b9c6-46a9-8d69-c48e11a96ec8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:30.566140 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-87747d65-ddfc-4750-bc44-40c6df50bd52 req-d8c0719b-b9c6-46a9-8d69-c48e11a96ec8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:08:30.579867 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'status': 'completed', 'code': 200}
May 26 15:08:30.657896 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-87747d65-ddfc-4750-bc44-40c6df50bd52 req-d8c0719b-b9c6-46a9-8d69-c48e11a96ec8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:08:30.659035 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-87747d65-ddfc-4750-bc44-40c6df50bd52 req-d8c0719b-b9c6-46a9-8d69-c48e11a96ec8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.2625098
May 26 15:08:30.721995 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-87747d65-ddfc-4750-bc44-40c6df50bd52 req-32913bb6-a0bb-41db-af0f-1696ad5e2b33 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0530815
May 26 15:08:30.727205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-6f2cfdb2-d1d4-48bc-9953-677bba6c2992 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:30.728581 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-6f2cfdb2-d1d4-48bc-9953-677bba6c2992 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1097 time: 0.1178401
May 26 15:08:30.868782 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-2c911c97-a499-4e98-993e-151f28ae579b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:30.870156 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-2c911c97-a499-4e98-993e-151f28ae579b service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=511d07599f124852b029e4bc01cbdd7f&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1334693
May 26 15:08:31.006477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-8d77dd62-723d-4ead-ab05-8c982bfc1c5f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:31.007854 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-8d77dd62-723d-4ead-ab05-8c982bfc1c5f service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1317666
May 26 15:08:31.115482 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-03759279-abb2-4881-96a4-2831cbd5d085 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:31.116970 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-03759279-abb2-4881-96a4-2831cbd5d085 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1097 time: 0.0708139
May 26 15:08:31.188511 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-1d53dafe-ba9e-4bb4-87c2-c868548d8642 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 200  len: 217 time: 0.0641637
May 26 15:08:31.253398 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-625cd1f5-1091-446d-b921-35f48d385046 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:31.254838 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-625cd1f5-1091-446d-b921-35f48d385046 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0603466
May 26 15:08:31.334899 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-c7da9f4d-6de5-4750-9928-da53f5d75adf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:31.336295 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-c7da9f4d-6de5-4750-9928-da53f5d75adf service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0746510
May 26 15:08:31.470495 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-2094a5a3-594a-48e5-b176-a11e56d5f25d service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1273396
May 26 15:08:31.692624 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c3912ed7-bc47-4b60-b726-d6413ebb6385 req-d9f27e88-cfb5-4a04-bd84-4fdb00844fed service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2159224
May 26 15:08:31.909784 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 req-8d4cab92-6835-4bfb-97c9-9fc79595d22b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:31.911233 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 req-8d4cab92-6835-4bfb-97c9-9fc79595d22b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0832090
May 26 15:08:31.955742 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 req-cd29e873-f32d-4017-b5fc-cb84c223c4a0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388045
May 26 15:08:33.141668 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc req-7226bd7b-3bd7-43d3-bfa5-0ef93a5cb606 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:33.143810 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc req-7226bd7b-3bd7-43d3-bfa5-0ef93a5cb606 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0822222
May 26 15:08:33.191242 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc req-7d260edd-3a34-47ed-9430-f83b3449f3a1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415463
May 26 15:08:34.374665 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b20a11-b30e-4048-81b5-2195ebc76eee req-0e1a80c6-f1bc-40b6-b1d2-aca2ef61b296 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:34.376641 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-97b20a11-b30e-4048-81b5-2195ebc76eee req-0e1a80c6-f1bc-40b6-b1d2-aca2ef61b296 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0791397
May 26 15:08:34.423817 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-97b20a11-b30e-4048-81b5-2195ebc76eee req-c0b96ca4-59b2-410c-9ef3-ada342fbba23 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0415864
May 26 15:08:35.609336 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb req-fb6ccc0a-6db9-4180-ae85-9eedf762e098 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:35.610816 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb req-fb6ccc0a-6db9-4180-ae85-9eedf762e098 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0825179
May 26 15:08:35.656858 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb req-5707ea25-a3c6-48c9-8d53-22639f4c564b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401163
May 26 15:08:36.838373 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09d393c-efe0-43c0-ac2d-0c78d754b60e req-e5f51e36-3d2f-4b2d-a939-163705632d80 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:36.839736 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c09d393c-efe0-43c0-ac2d-0c78d754b60e req-e5f51e36-3d2f-4b2d-a939-163705632d80 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0792744
May 26 15:08:36.884139 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-c09d393c-efe0-43c0-ac2d-0c78d754b60e req-cadf9e15-4aaa-47ef-a0be-da3157f3ff53 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388246
May 26 15:08:38.077250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2518c4bb-5630-4503-b42b-7641afed53a2 req-5d7ea7b3-e4de-46d2-aaf9-4e4ce6c48454 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:38.078743 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2518c4bb-5630-4503-b42b-7641afed53a2 req-5d7ea7b3-e4de-46d2-aaf9-4e4ce6c48454 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0842743
May 26 15:08:38.125675 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2518c4bb-5630-4503-b42b-7641afed53a2 req-f598234a-884b-4fa6-be67-bea74d1a3509 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0409906
May 26 15:08:39.017225 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 8a04a399-0467-4790-95e0-0eafe7abfa35 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:08:39.157467 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=8a04a399-0467-4790-95e0-0eafe7abfa35,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:39.170854 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'port_id': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'mac_address': 'fa:16:3e:8a:0d:0c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1246, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:08:39.226506 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:39.243701 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8a04a399-0467-4790-95e0-0eafe7abfa35 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:08:39.258716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=8a04a399-0467-4790-95e0-0eafe7abfa35,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:39.314096 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcbbf859-3e39-4bd4-93ba-cc886caae14e req-3b06c6fb-6f04-4fb2-93ef-2223215fabe8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:39.315515 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fcbbf859-3e39-4bd4-93ba-cc886caae14e req-3b06c6fb-6f04-4fb2-93ef-2223215fabe8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 944 time: 0.0853279
May 26 15:08:39.318096 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:39.319873 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:39.362469 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-fcbbf859-3e39-4bd4-93ba-cc886caae14e req-98cca002-d375-4c9d-a2f9-917c70b1d306 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0410166
May 26 15:08:39.388581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:39.391714 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:39.562012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['8a04a399-0467-4790-95e0-0eafe7abfa35'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:08:40.547066 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 req-41e5e7c3-8678-43e6-acaf-68a1f189408c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:40.548604 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 req-41e5e7c3-8678-43e6-acaf-68a1f189408c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 945 time: 0.0813758
May 26 15:08:40.594123 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 req-63434997-566c-410f-8c70-47230e3e15bc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397840
May 26 15:08:41.032827 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 8a04a399-0467-4790-95e0-0eafe7abfa35 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:08:41.163656 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 8a04a399-0467-4790-95e0-0eafe7abfa35 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:08:41.168570 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 8a04a399-0467-4790-95e0-0eafe7abfa35 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:08:41.168939 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:41.284005 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:41.309892 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:08:41.319318 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=8a04a399-0467-4790-95e0-0eafe7abfa35,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:08:41.401614 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:41.403534 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:41.441353 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'code': 200}
May 26 15:08:41.473319 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:41.476338 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:41.838866 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c1a18d-9fab-48d6-aef1-19b45a799c5f req-8bf31a37-8e1d-4a09-8dbb-faa6c43b6302 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:41.840234 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-59c1a18d-9fab-48d6-aef1-19b45a799c5f req-8bf31a37-8e1d-4a09-8dbb-faa6c43b6302 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.1422572
May 26 15:08:41.842795 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06bca803-0130-4cda-b766-632bf8fb6dcb req-d3e53087-0a57-4eff-9a94-9a609d05ac38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:41.844143 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-06bca803-0130-4cda-b766-632bf8fb6dcb req-d3e53087-0a57-4eff-9a94-9a609d05ac38 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1099 time: 0.1059167
May 26 15:08:41.914767 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-59c1a18d-9fab-48d6-aef1-19b45a799c5f req-cc28624b-1f94-474f-9ac1-09f623643872 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0688951
May 26 15:08:41.916372 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-06bca803-0130-4cda-b766-632bf8fb6dcb req-0a5b8730-e357-466e-8cb8-9ee0254ff920 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0578642
May 26 15:08:43.104895 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd38698-972d-4903-929a-5aff20b403a5 req-2f4e9864-b90b-4048-b5a1-c80eafadc268 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:43.106395 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6fd38698-972d-4903-929a-5aff20b403a5 req-2f4e9864-b90b-4048-b5a1-c80eafadc268 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.0852506
May 26 15:08:43.150833 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6fd38698-972d-4903-929a-5aff20b403a5 req-ab20e2ed-47ef-461a-8604-088147c8e280 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387125
May 26 15:08:43.332828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd req-0db0abb7-deb6-43fb-9ebf-a0c60f471cfc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:43.334371 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd req-0db0abb7-deb6-43fb-9ebf-a0c60f471cfc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.0811059
May 26 15:08:43.377957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd req-d32e5593-6a70-497f-a48c-6d629d3d3d89 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0379674
May 26 15:08:43.401966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37336) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:43.515525 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8597a7fd-e8ce-4a27-b3d9-a1636df53a5d tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:43.516137 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8597a7fd-e8ce-4a27-b3d9-a1636df53a5d tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] Synchronizing usage tracker for tenant:a056c271765b428094429bd897256335 on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:08:43.715458 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-8597a7fd-e8ce-4a27-b3d9-a1636df53a5d tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] Unset dirty status for tenant:a056c271765b428094429bd897256335 on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:08:43.716671 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-8597a7fd-e8ce-4a27-b3d9-a1636df53a5d tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1094 time: 0.3137212
May 26 15:08:43.719509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37342) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:08:43.724646 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'port_id': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:08:43.730985 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:08:43.734865 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:floatingip and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:08:43.737744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:08:43.744543 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:08:43.835815 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:43.984578 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:44.153807 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.27.2.226 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/f7880de0-c1ec-499a-83e8-caf76af59eb9) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:08:44.327823 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:44.433266 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:44.437047 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-0f477541-5f16-4d24-b54e-a6d0db993c33 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:44.499078 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:08:44.501767 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:08:44.506699 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:08:44.540413 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=f7880de0-c1ec-499a-83e8-caf76af59eb9,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:44.548461 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:45.016813 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:45.148420 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:45.353941 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:45.406913 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:45.412355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-41ed3548-04dc-473c-bc0b-15b523add921 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:08:45.524034 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=f7880de0-c1ec-499a-83e8-caf76af59eb9,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:08:45.526836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:08:45.531559 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:45.701251 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 00c68e1a-4f21-4cb9-a44a-89f11128a98e associated. External IP: 172.27.2.226, port: 8a04a399-0467-4790-95e0-0eafe7abfa35.
May 26 15:08:46.048465 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:08:46.227075 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:08:46.236661 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:08:46.246578 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:46.247192 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabfed8f10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:08:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:46.323835 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:46.379907 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.6593633
May 26 15:08:46.380797 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:08:46.433041 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:46.476054 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'status': 'completed', 'code': 200}
May 26 15:08:46.578288 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-781d5d2c-d06d-4992-a698-713f12e12677 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:46.579749 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-781d5d2c-d06d-4992-a698-713f12e12677 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1099 time: 0.0801363
May 26 15:08:46.832938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-5c7e7a3a-6e18-43c9-b60e-a5adfec95c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:46.834336 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-5c7e7a3a-6e18-43c9-b60e-a5adfec95c28 service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.2484100
May 26 15:08:46.836245 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabfed8f10>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '00c68e1a-4f21-4cb9-a44a-89f11128a98e', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.226', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:8a:0d:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:08:44Z', 'updated_at': '2021-05-26T15:08:44Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:46.840087 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:08:46.848845 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:08:46.849497 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabfed8f10>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:08:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:46.937533 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-adc3b4bf-f823-46b1-9a95-8ad730e87003 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 200  len: 1000 time: 0.0962858
May 26 15:08:47.000480 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-13ba1a5a-6c9c-46ca-bec3-eef59a8740fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:47.001953 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-13ba1a5a-6c9c-46ca-bec3-eef59a8740fa service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0581183
May 26 15:08:47.028165 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:08:47.081455 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-2fabbe6f-73e2-43d7-ba7d-a506b21da466 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:08:47.083681 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-2fabbe6f-73e2-43d7-ba7d-a506b21da466 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0759220
May 26 15:08:47.220051 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-0dcccc04-ed44-43c0-81a4-04ee31ac5fbf service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1295896
May 26 15:08:47.353023 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-91949841-3050-4e68-a8c5-0b5a4dda4db8 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1266482
May 26 15:08:47.386916 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-4daac549-308a-48de-98a9-b1065308d731 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabfed8f10>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '00c68e1a-4f21-4cb9-a44a-89f11128a98e', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.226', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:8a:0d:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:08:44Z', 'updated_at': '2021-05-26T15:08:44Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:08:47.391891 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4daac549-308a-48de-98a9-b1065308d731 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '00c68e1a-4f21-4cb9-a44a-89f11128a98e', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.226', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 681, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:8a:0d:0c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:08:44Z', 'updated_at': '2021-05-26T15:08:44Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:08:47.574855 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10cd61c3-7c75-44e7-9ff3-5d53b51b983c None None] New status for floating IP 00c68e1a-4f21-4cb9-a44a-89f11128a98e: ACTIVE {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:08:50.549875 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-52fac484-7ac2-47d0-8a41-0e6c992ab45d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:53.163351 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:53.195077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-9cba17f0-2d45-4618-9690-ddadb0cc9240 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:54.115996 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:55.655246 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:08:59.444109 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:05.279635 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:09:05.476854 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-d0e2ee7f-d328-4f41-9b61-5abc15e1542a service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0733032
May 26 15:09:05.621968 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-321e9054-3ce4-460b-a7cb-7d206cb2bd18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:09:05.623418 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-321e9054-3ce4-460b-a7cb-7d206cb2bd18 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1099 time: 0.0711837
May 26 15:09:05.767558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-071025be-34d3-43bc-9b62-47e2712a452e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:09:05.768976 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-071025be-34d3-43bc-9b62-47e2712a452e service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1253242
May 26 15:09:05.871456 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-b9222400-b8cb-43ef-9109-7f3887187654 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 200  len: 1002 time: 0.0954723
May 26 15:09:05.937372 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-e0a00b2e-879c-42f7-a62a-42e4c3219a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:09:05.938786 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-e0a00b2e-879c-42f7-a62a-42e4c3219a83 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0602710
May 26 15:09:06.012935 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-9f0f9159-1e23-44fa-8287-5680fb18a15b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:09:06.014392 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-9f0f9159-1e23-44fa-8287-5680fb18a15b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0691829
May 26 15:09:06.146985 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-6bd72ca6-2923-47d0-87e4-6a05a83235d9 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1239460
May 26 15:09:06.279510 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-92e862ef-c8a2-46ed-bd4b-a9c7bca4db77 req-e69e5ad1-db04-4bbe-b5ad-2c2b82f3b94f service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1247811
May 26 15:09:20.509208 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a0a2b033-64e1-4499-81c6-fd13d517cf10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:23.126692 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:23.191535 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-282155f5-b873-4e3b-a7f4-e8e793ebc099 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:24.091923 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:25.632217 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:29.431844 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:42.279099 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:09:50.506170 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-34b68414-b690-441e-99b3-f948c13c558d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:53.134536 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:53.163327 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-869f7756-2e28-47a8-8b38-74e81a8c92dc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:54.088586 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:55.671666 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:09:59.452202 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:06.075472 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-c79beb59-d1fc-48e7-ae83-ec7e55dd14fd service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0689769
May 26 15:10:06.216990 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-f77adb79-30a4-4d74-a9ee-6839e034e532 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:06.218483 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-f77adb79-30a4-4d74-a9ee-6839e034e532 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 1099 time: 0.0753787
May 26 15:10:06.457195 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-d5db27a2-d252-4f84-b73f-3caef6092553 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:06.459344 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-d5db27a2-d252-4f84-b73f-3caef6092553 service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.2208190
May 26 15:10:06.561855 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-4bf22b2d-2407-46b5-b7dd-83460267bdcd service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 200  len: 1002 time: 0.0957198
May 26 15:10:06.622355 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-2f875a9a-ee3a-40f4-8cde-385fb0c242b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:06.623742 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-2f875a9a-ee3a-40f4-8cde-385fb0c242b8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0561604
May 26 15:10:06.701180 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-7c6ca9b9-79d5-45f0-9617-82073c937a44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:06.702620 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-7c6ca9b9-79d5-45f0-9617-82073c937a44 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0725069
May 26 15:10:06.833967 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-97819706-f516-4313-bfa7-01bd6d59f5ee service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1240799
May 26 15:10:06.964672 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-6baeceec-2831-44fc-a60d-a96bb1488e9d req-c0d460ec-7e60-4d53-85f8-729acacb0a61 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1247175
May 26 15:10:19.277803 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:10:20.491342 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-763f1cf6-ef03-4f14-a526-0cd964cb8269 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:23.114414 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:23.194387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-f393bbcf-25b0-488c-bd7f-12c29cccb834 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:24.105962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:25.691528 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:29.502687 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:41.669883 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 req-6e9a2c77-2ad7-4cf3-a768-9e6c202e21d8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:41.671327 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 req-6e9a2c77-2ad7-4cf3-a768-9e6c202e21d8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.0841558
May 26 15:10:41.715276 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 req-fd6e6217-19b8-4ae1-9b1d-728fee974420 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383267
May 26 15:10:42.899588 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 req-270c0c8e-f540-45c7-9e8f-ef03ce681f75 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:42.901036 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 req-270c0c8e-f540-45c7-9e8f-ef03ce681f75 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.0803947
May 26 15:10:42.944778 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 req-bc54137a-87ff-4a56-b4cd-c7009ae3b67a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381207
May 26 15:10:43.117146 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-b6d16afe-310d-49ae-8c9c-440055db7406 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:43.118586 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-b6d16afe-310d-49ae-8c9c-440055db7406 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 946 time: 0.0844686
May 26 15:10:43.249353 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port 8a04a399-0467-4790-95e0-0eafe7abfa35 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:10:43.249633 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:43.382641 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] For port 8a04a399-0467-4790-95e0-0eafe7abfa35, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=8a04a399-0467-4790-95e0-0eafe7abfa35,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:10:43.382990 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:43.671880 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:43.672242 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:43.672549 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 00c68e1a-4f21-4cb9-a44a-89f11128a98e disassociated. External IP: 172.27.2.226, port: 8a04a399-0467-4790-95e0-0eafe7abfa35.
May 26 15:10:43.672876 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for 8a04a399-0467-4790-95e0-0eafe7abfa35 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:10:43.834327 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:43.840140 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ed0e6683-eafd-4b96-b1a7-d44213d3e0e1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:10:43.888907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=8a04a399-0467-4790-95e0-0eafe7abfa35,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:10:43.901826 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.902350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.902550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.902939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.903250 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.903608 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.903959 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.904311 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.904663 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.905011 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.905370 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.905743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:10:43.947637 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:10:44.135144 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c req-151893a5-43be-467f-9dc4-b5738c519f85 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 210 time: 0.0506110
May 26 15:10:44.216966 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:10:44.415022 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:10:44.426033 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:10:44.436754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:10:44.437388 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46540d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:10:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:10:44.501337 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] No DVR routers for this DVR port 8a04a399-0467-4790-95e0-0eafe7abfa35 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:10:44.503967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:44.507112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'name': 'network-vif-deleted', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:10:44.558461 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7dcf546b-91d5-4718-b3f0-dee33dda4ce7', 'name': 'network-vif-deleted', 'tag': '8a04a399-0467-4790-95e0-0eafe7abfa35', 'status': 'completed', 'code': 200}
May 26 15:10:44.581153 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "DELETE /v2.0/ports/8a04a399-0467-4790-95e0-0eafe7abfa35 HTTP/1.1" status: 204  len: 173 time: 1.4569900
May 26 15:10:44.648031 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:10:45.001214 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46540d0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:10:45.005040 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:10:45.014111 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:10:45.016754 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46540d0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:10:23Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:10:45.195128 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:10:45.310079 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-743c4857-4333-454d-97e6-e8642001ed6d req-5dfe4878-bc68-4fa1-84e5-b8639ac64a8d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=7dcf546b-91d5-4718-b3f0-dee33dda4ce7 HTTP/1.1" status: 200  len: 210 time: 0.0505960
May 26 15:10:45.511293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46540d0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:10:45.515556 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95cedd78-712e-4119-a44d-1fb8bba5d940 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:10:45.566497 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 8a04a399-0467-4790-95e0-0eafe7abfa35 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:10:45.600258 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 8a04a399-0467-4790-95e0-0eafe7abfa35 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:10:45.600607 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 8a04a399-0467-4790-95e0-0eafe7abfa35 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:10:45.727691 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f488d7c9-f68d-4bfc-ae89-9717f6f3fd83 None None] New status for floating IP 00c68e1a-4f21-4cb9-a44a-89f11128a98e: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:10:46.640105 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-888859d3-b0d1-4549-b56d-487d711e66a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-675203712&fields=id&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 267 time: 0.0407422
May 26 15:10:46.788788 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-b1a497f2-c362-4d6f-aa5f-e8cb457675e7 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:46.790320 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-b1a497f2-c362-4d6f-aa5f-e8cb457675e7 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.1436861
May 26 15:10:46.804490 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-5b6ef464-103d-40e9-83e2-7efa61a6fcaa tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/quotas/511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 375 time: 0.0087669
May 26 15:10:46.886809 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-d97617d5-72f8-45f1-ab60-ebc2f13a7db5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0775435
May 26 15:10:47.023725 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-ae55858f-8aa8-461e-849d-a6a7b87bc4dd service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1254871
May 26 15:10:47.155805 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-4da892e4-14a0-47bd-9e7e-0652d3752764 service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252649
May 26 15:10:48.851980 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-a86fe4d2-d018-4588-9d7d-119ac49f498b req-3ce0873b-dd75-4515-9c70-90d94cf9f509 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:10:48.971281 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-a86fe4d2-d018-4588-9d7d-119ac49f498b req-3ce0873b-dd75-4515-9c70-90d94cf9f509 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:10:48.972462 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a86fe4d2-d018-4588-9d7d-119ac49f498b req-3ce0873b-dd75-4515-9c70-90d94cf9f509 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.1687849
May 26 15:10:50.070680 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-d6f37ce8-9736-471f-b98d-6436db85da0c req-8ca2da70-8267-41cd-a367-afedb4f89748 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.0461242
May 26 15:10:50.494558 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-0fad8ca7-329c-46bd-a203-b8d957ad2903 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:51.169174 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f0f0bb13-d98d-4762-b3d9-9f07f98d5d9c req-1e2ed047-d52e-4fbb-bdc1-2bcfd03d0c05 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.0433156
May 26 15:10:52.262456 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8f2f1cd9-3a67-4b44-bb0c-fb81c12890fc req-4cb3583c-ea53-4314-80b2-ab5801c755f3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.0429871
May 26 15:10:53.148126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:53.179837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-223829dd-7191-49be-8cd9-cb17d6618bc9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:53.410797 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 req-c2b375bf-b346-4e1c-b5db-7e249621cc99 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.0458736
May 26 15:10:54.091497 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:54.565489 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 req-2aa1f39c-4db4-4703-ae7f-2023d3c285ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.0488238
May 26 15:10:54.918959 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-200011c4-375a-4a29-be85-0995778bb31a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:54.920358 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-200011c4-375a-4a29-be85-0995778bb31a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.1493406
May 26 15:10:54.968143 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-0eda06ff-610f-4f61-867c-e6a265ee0b85 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 379 time: 0.0398257
May 26 15:10:54.976416 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'port': {'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'admin_state_up': True, 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'security_groups': ['1c3a2647-9496-45b8-89c8-8ccb8faa8126']}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:10:55.113927 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:10:55.124352 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:10:55.222714 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Made reservation on behalf of 511d07599f124852b029e4bc01cbdd7f for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:10:55.226195 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:55.390729 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.20.0.6 (8cb13f82-5501-498d-8d6a-19501eaaa488/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6/e19df163-9d36-4b27-a614-a95afeeb27c6) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:10:55.577824 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:55.594755 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Transition to ACTIVE for port object e19df163-9d36-4b27-a614-a95afeeb27c6 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:10:55.694369 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:55.710505 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:55.720251 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-59b7023b-4771-428d-8905-e0ee2d480520 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:10:55.800170 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:10:55.803828 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:10:55.815497 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:10:55.843294 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:10:55.853740 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:10:55.888405 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03f3037-79bb-4071-91a5-fda18a7a0f7a req-5ca9392f-6362-45f8-a01b-f04e94c0e4b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:55.889964 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e03f3037-79bb-4071-91a5-fda18a7a0f7a req-5ca9392f-6362-45f8-a01b-f04e94c0e4b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 931 time: 0.2169869
May 26 15:10:55.898612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:55.901083 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:55.962687 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e03f3037-79bb-4071-91a5-fda18a7a0f7a req-f5521048-e701-41f0-9e22-3250989b289e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0588763
May 26 15:10:56.026850 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-761b59cf-48f6-4954-996f-51354d1cda31 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.0539837
May 26 15:10:56.038923 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Request body: {'port': {'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:10:56.147729 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:56.162846 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7a025998-c116-4041-972e-2d878592a90c None None] Provisioning for port e19df163-9d36-4b27-a614-a95afeeb27c6 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:10:56.168710 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-7a025998-c116-4041-972e-2d878592a90c None None] Provisioning complete for port e19df163-9d36-4b27-a614-a95afeeb27c6 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:10:56.169087 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7a025998-c116-4041-972e-2d878592a90c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:56.224300 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-7a025998-c116-4041-972e-2d878592a90c None None] Port e19df163-9d36-4b27-a614-a95afeeb27c6 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:10:56.276653 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:10:56.597127 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e19df163-9d36-4b27-a614-a95afeeb27c6 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:10:56.604332 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:56.618158 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Transition to ACTIVE for port object e19df163-9d36-4b27-a614-a95afeeb27c6 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:10:56.694592 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:56.698338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:10:56.850493 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Pushing event updated for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:10:56.858983 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:10:56.936061 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Attempting to bind port e19df163-9d36-4b27-a614-a95afeeb27c6 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:10:56.936396 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Attempting to bind port e19df163-9d36-4b27-a614-a95afeeb27c6 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:10:56.936723 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Attempting to bind port e19df163-9d36-4b27-a614-a95afeeb27c6 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:10:56.941505 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Port e19df163-9d36-4b27-a614-a95afeeb27c6 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:10:56.941847 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Attempting to bind port e19df163-9d36-4b27-a614-a95afeeb27c6 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:10:56.946928 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 10, 29), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:10:56.947257 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:10:56.948154 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Bound using segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:10:56.949325 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Bound port: e19df163-9d36-4b27-a614-a95afeeb27c6, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:10:56.949718 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:57.037485 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:10:57.040380 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e19df163-9d36-4b27-a614-a95afeeb27c6,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:10:57.091622 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:57.095441 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f84a9b9a-20d0-45fb-8c8e-3602c8bb7e03 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:10:57.155016 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.156034 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:57.157630 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] 10.222.0.32 "PUT /v2.0/ports/e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 1093 time: 1.1226680
May 26 15:10:57.158312 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb766bb-1076-47c4-8187-3f4f2db3634e req-8039130b-2f7a-419f-b4f8-82f5047c35fe tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.159815 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8cb766bb-1076-47c4-8187-3f4f2db3634e req-8039130b-2f7a-419f-b4f8-82f5047c35fe tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0873137
May 26 15:10:57.160891 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:10:57.188601 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Pushing event updated for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:10:57.192226 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:10:57.216075 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'status': 'completed', 'code': 200}
May 26 15:10:57.223928 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8cb766bb-1076-47c4-8187-3f4f2db3634e req-334395b4-d8cc-48e9-9551-29f382dc653e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0522838
May 26 15:10:57.318973 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-b9eaeecd-bb55-4f70-a30e-e8a340c69120 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.320360 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-b9eaeecd-bb55-4f70-a30e-e8a340c69120 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1096 time: 0.0826385
May 26 15:10:57.462955 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-c537e1cb-ad45-478b-914e-cd6f7a952aea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.464348 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-c537e1cb-ad45-478b-914e-cd6f7a952aea service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=511d07599f124852b029e4bc01cbdd7f&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1362171
May 26 15:10:57.607618 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-509a018a-69cb-4a21-a19a-4a0b04e315b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.609057 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-509a018a-69cb-4a21-a19a-4a0b04e315b7 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1388209
May 26 15:10:57.717298 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-4d47909e-9dc5-4756-81bf-07503251f6f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.718784 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-4d47909e-9dc5-4756-81bf-07503251f6f2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1096 time: 0.0752926
May 26 15:10:57.789455 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-eb4f0f43-131c-41ec-acbc-f952f0f66aeb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 217 time: 0.0636966
May 26 15:10:57.853918 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-27ee1111-d604-499e-8702-5f892d674f9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.855952 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-27ee1111-d604-499e-8702-5f892d674f9d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0604084
May 26 15:10:57.929833 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-90ac5d09-007a-47d8-8a4d-a928e1988115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:57.931278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-90ac5d09-007a-47d8-8a4d-a928e1988115 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0692549
May 26 15:10:58.062772 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-a4664ff3-a7ed-49ab-b185-20bee2874c82 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1243558
May 26 15:10:58.279615 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 req-91f83ae9-b1c8-4575-b659-2cd1ca226176 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2100301
May 26 15:10:58.427855 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34707b08-a835-486b-a598-858d166ca222 req-96908a67-eadc-49f4-9c34-31dd72e0d539 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:58.428549 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-34707b08-a835-486b-a598-858d166ca222 req-96908a67-eadc-49f4-9c34-31dd72e0d539 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:10:58.499811 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-34707b08-a835-486b-a598-858d166ca222 req-96908a67-eadc-49f4-9c34-31dd72e0d539 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:10:58.500958 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-34707b08-a835-486b-a598-858d166ca222 req-96908a67-eadc-49f4-9c34-31dd72e0d539 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.1569717
May 26 15:10:58.547559 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-34707b08-a835-486b-a598-858d166ca222 req-e1b93783-2ed4-4f64-991c-703c9bf34a7b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0407665
May 26 15:10:59.467964 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:10:59.728253 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92cb4709-4b93-4a74-b158-f4a49b22c9ba req-cf6e17b5-744e-4719-97c5-8a17552d8740 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:10:59.729688 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92cb4709-4b93-4a74-b158-f4a49b22c9ba req-cf6e17b5-744e-4719-97c5-8a17552d8740 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0780494
May 26 15:10:59.858552 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-92cb4709-4b93-4a74-b158-f4a49b22c9ba req-a3633db8-b82c-4d04-8851-844f394f6794 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1230454
May 26 15:11:01.045586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9802575d-fbe5-4b53-bfb9-348cf6851e8c req-fe5add1a-b9b3-4c7f-aeac-ce34260b7944 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:01.047031 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9802575d-fbe5-4b53-bfb9-348cf6851e8c req-fe5add1a-b9b3-4c7f-aeac-ce34260b7944 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0804334
May 26 15:11:01.091301 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9802575d-fbe5-4b53-bfb9-348cf6851e8c req-b882aa91-6196-4139-af7b-2870a271019d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387361
May 26 15:11:02.271396 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b1ec77-9247-440d-afaa-1b8aec409a82 req-501b8532-502a-4fbb-8ed2-e24077a85546 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:02.274216 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-72b1ec77-9247-440d-afaa-1b8aec409a82 req-501b8532-502a-4fbb-8ed2-e24077a85546 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0784228
May 26 15:11:02.317951 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-72b1ec77-9247-440d-afaa-1b8aec409a82 req-647b21c4-982a-4ca9-9cbb-0117b2e24107 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0394797
May 26 15:11:03.505811 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77740c9c-8d82-45ac-8e90-2e658a64990e req-44c0c381-2a97-4b12-ab52-55627c72be66 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:03.507274 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77740c9c-8d82-45ac-8e90-2e658a64990e req-44c0c381-2a97-4b12-ab52-55627c72be66 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0850925
May 26 15:11:03.551873 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-77740c9c-8d82-45ac-8e90-2e658a64990e req-c6aa0068-bdf3-4929-8af0-0676c048ca47 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389519
May 26 15:11:04.740236 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 req-2d69ffa5-5794-404e-8177-98a2c4c1cdf8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:04.741697 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 req-2d69ffa5-5794-404e-8177-98a2c4c1cdf8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0822411
May 26 15:11:04.785712 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 req-56aa832b-09c7-4811-b349-1d7fb6b39911 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0384333
May 26 15:11:05.671347 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e19df163-9d36-4b27-a614-a95afeeb27c6 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:11:05.802415 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e19df163-9d36-4b27-a614-a95afeeb27c6,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:11:05.816263 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1246, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:11:05.877107 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:05.894391 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e19df163-9d36-4b27-a614-a95afeeb27c6 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:11:05.910570 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e19df163-9d36-4b27-a614-a95afeeb27c6,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:11:05.973509 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4522e070-358d-4be2-8d7e-328d4c9355d0 req-9d44d245-bd37-4752-ae9d-0fe5418ef3ed tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:05.974909 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4522e070-358d-4be2-8d7e-328d4c9355d0 req-9d44d245-bd37-4752-ae9d-0fe5418ef3ed tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 943 time: 0.0815849
May 26 15:11:06.022990 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-4522e070-358d-4be2-8d7e-328d4c9355d0 req-a83dc166-e07c-4b94-8f97-b9e942c8423c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0423753
May 26 15:11:06.026016 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:06.029895 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:11:06.095386 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:11:06.102489 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.102836 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.103200 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.103532 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.103860 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.104189 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.104513 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.104837 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.105162 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.105482 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.105822 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.106142 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:06.110212 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:11:06.230103 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['e19df163-9d36-4b27-a614-a95afeeb27c6'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:11:07.203658 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b req-6b973188-04a8-4553-8385-35c07d01cdc2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:07.205109 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b req-6b973188-04a8-4553-8385-35c07d01cdc2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 944 time: 0.0784886
May 26 15:11:07.249007 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b req-c7172427-f491-4c16-82ec-1074c9e1f537 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0383141
May 26 15:11:07.670718 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e19df163-9d36-4b27-a614-a95afeeb27c6 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:11:07.796897 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port e19df163-9d36-4b27-a614-a95afeeb27c6 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:11:07.801454 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port e19df163-9d36-4b27-a614-a95afeeb27c6 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:11:07.801849 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:07.942293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:07.968219 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:11:07.984662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e19df163-9d36-4b27-a614-a95afeeb27c6,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:11:08.013220 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'code': 200}
May 26 15:11:08.065836 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:08.067703 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-11efb188-8051-4ffa-8812-3a920ce045ea None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:11:08.133389 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:11:08.136492 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:11:08.432539 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87b8a5dc-25df-46dd-b338-0fc21fcac34e req-0ede859d-013a-4473-93b9-e12a59a688c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:08.434019 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-87b8a5dc-25df-46dd-b338-0fc21fcac34e req-0ede859d-013a-4473-93b9-e12a59a688c4 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0711193
May 26 15:11:08.435939 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-984731db-776c-4721-ab26-f509f349e05c req-4290f67a-02bc-4907-8c42-2898351c0c4a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:08.438041 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-984731db-776c-4721-ab26-f509f349e05c req-4290f67a-02bc-4907-8c42-2898351c0c4a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.0845542
May 26 15:11:08.474544 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-87b8a5dc-25df-46dd-b338-0fc21fcac34e req-d8e5d98a-313d-4102-89b3-169925438f0e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0340526
May 26 15:11:08.483974 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-984731db-776c-4721-ab26-f509f349e05c req-6eb2cb67-b22b-4006-9830-c1c92ae8b877 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0395539
May 26 15:11:09.677449 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9464df09-baa4-42d5-b94e-65861bad992f req-a1c70b1f-de27-47ce-be7d-3f7b3c67cba2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:09.678921 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9464df09-baa4-42d5-b94e-65861bad992f req-a1c70b1f-de27-47ce-be7d-3f7b3c67cba2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.0854027
May 26 15:11:09.723582 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-9464df09-baa4-42d5-b94e-65861bad992f req-0d834ee6-226c-4bbc-80fd-b4feaa85f292 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0389845
May 26 15:11:09.906548 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 req-cc42e279-6792-47bd-8d86-0325b8cf1587 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:09.908020 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 req-cc42e279-6792-47bd-8d86-0325b8cf1587 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.0798349
May 26 15:11:09.956742 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 req-064a6fe5-e283-4432-b088-3b0505906ee5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0431314
May 26 15:11:09.979532 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37478) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:11:10.048808 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c42db33-21da-4d05-b046-7c2d3bd07865 tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:10.050297 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-5c42db33-21da-4d05-b046-7c2d3bd07865 tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1093 time: 0.0698237
May 26 15:11:10.052957 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37482) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:11:10.057874 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.v2.base [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103981) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:11:10.063679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:11:10.067440 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:floatingip and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:11:10.070228 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.quota.resource [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=103981) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:11:10.075837 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.quota.driver [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=103981) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:11:10.191485 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:10.326302 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:10.461577 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_common [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.27.2.162 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/bb77c64d-f35b-47ee-bbab-b3f67675e5da) {{(pid=103981) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:11:10.608790 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:10.730091 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:10.733856 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cf0df18e-f3ae-4b6f-843b-abaf3c592e81 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:11:10.796427 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103981) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:11:10.799364 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.base_scheduler [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103981) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:11:10.801906 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103981) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:11:10.840048 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=bb77c64d-f35b-47ee-bbab-b3f67675e5da,revision_number=1']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:11:10.855733 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.856111 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.856474 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.856832 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.857185 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.857558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.857916 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.858267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.858617 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.859016 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.859311 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.859686 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:11:10.863420 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:11:11.216176 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:11.363357 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:11.653037 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:11.714028 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2225511'] for port, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:11.718622 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cb58a350-a2c1-4ae8-9b53-c34acce27255 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:11:11.824112 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=bb77c64d-f35b-47ee-bbab-b3f67675e5da,revision_number=2']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:11:11.828115 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:11:11.833167 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:11.998229 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.db.l3_db [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 275c3687-5bbc-49dc-9c23-c571b59616a0 associated. External IP: 172.27.2.162, port: e19df163-9d36-4b27-a614-a95afeeb27c6.
May 26 15:11:12.346482 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:11:12.521231 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:11:12.530511 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:11:12.540478 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:11:12.541100 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac425fc40>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:10:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:11:12.628070 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:12.687241 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-804430c8-60c7-491f-9050-5626380a289b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.6332657
May 26 15:11:12.687917 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6'}] {{(pid=103981) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:11:12.729077 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:11:12.785963 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'status': 'completed', 'code': 200}
May 26 15:11:12.876914 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-937a1874-7e0d-40a5-82e0-c53705619d49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:12.878402 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-937a1874-7e0d-40a5-82e0-c53705619d49 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0719743
May 26 15:11:13.015439 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-2badecd3-3d42-4764-88a7-bf397e8d4d40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:13.018044 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-2badecd3-3d42-4764-88a7-bf397e8d4d40 service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1335618
May 26 15:11:13.075767 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac425fc40>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:11Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:11:13.080092 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:11:13.088429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:11:13.089031 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac425fc40>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:10:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:11:13.122982 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-0a23f29e-337b-4b65-8dcc-14b04a658708 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 999 time: 0.0989001
May 26 15:11:13.184938 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-182059a0-8834-4f6d-813c-2fb834821c57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:13.186380 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-182059a0-8834-4f6d-813c-2fb834821c57 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0567224
May 26 15:11:13.263222 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-2714fb6a-99b3-43d0-afdc-e85ac8f5a9fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:11:13.264682 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-2714fb6a-99b3-43d0-afdc-e85ac8f5a9fc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0724006
May 26 15:11:13.267393 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:11:13.401931 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-f908baf4-8bde-4914-a7e4-dcb5435afbb9 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1302102
May 26 15:11:13.534775 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-b025b38e-e3bb-4b25-99fd-487f0633b53d service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1267831
May 26 15:11:13.612585 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac425fc40>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:11Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:11:13.616441 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f56393b1-3780-492e-9ed7-486c6edc5beb None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:11Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:11:13.786644 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e86a82c5-cf28-4cea-9d45-548d96627934 None None] New status for floating IP 275c3687-5bbc-49dc-9c23-c571b59616a0: ACTIVE {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:11:20.506350 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-67996630-c4cd-497c-b52d-34941433b44b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:23.176597 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:23.244905 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-454c0176-7d33-4081-bea3-beb8283d7614 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:24.108270 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:25.659746 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:29.499917 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:33.276884 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:11:50.547487 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2e60552b-f750-4ef4-8e7d-dec77b3ff43b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:53.141676 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:53.170505 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-426872de-c7ab-4e2b-a6b8-afa9b8ddd2a3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:54.119119 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:55.676588 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:11:59.501724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:09.449328 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-1b532ce3-d42f-4855-a56b-a1d2c2c811c7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0698767
May 26 15:12:09.588911 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-70cd5b2f-4fef-44b1-9d49-accf534907a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:12:09.590392 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-70cd5b2f-4fef-44b1-9d49-accf534907a4 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0740638
May 26 15:12:09.821488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-c2d7b251-3c05-4647-84c5-0a3fe6ec3a1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:12:09.822943 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-c2d7b251-3c05-4647-84c5-0a3fe6ec3a1d service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.2140138
May 26 15:12:09.924020 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-5f608569-286d-4573-b94b-51ca29f91c6c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 1001 time: 0.0939677
May 26 15:12:09.985626 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-b0380882-ae06-4265-b630-e8f17f3945ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:12:09.986977 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-b0380882-ae06-4265-b630-e8f17f3945ca service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0561349
May 26 15:12:10.060211 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-decc1f85-e145-4b92-8d88-70896cdffd0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:12:10.061666 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-decc1f85-e145-4b92-8d88-70896cdffd0b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0685706
May 26 15:12:10.191992 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-df1c1268-bc85-45a9-a245-101c305c98b4 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1234288
May 26 15:12:10.275627 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:12:10.324854 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e820cf2e-96ef-4d7b-99f6-b16e64e1b025 req-b0031d56-64e9-4c9a-9969-1e2a94b7f2d0 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1260941
May 26 15:12:20.495740 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cb647f0c-13bb-4821-b241-635b5cdd7c05 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:23.139260 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:23.167713 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4b1a5718-6750-4c91-98eb-91b4649522b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:24.100338 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:25.655442 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:29.490407 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:47.274877 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:12:50.495465 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-67a78261-a9c1-4c8f-8cc5-e03ef5ea0232 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:53.145667 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:53.169962 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-637c7f1b-6af2-4a85-99e5-4b14d3ebdf27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:54.089914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:55.664843 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:12:59.501050 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:00.872676 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d401f77c-d155-423b-b656-2cef2d858bdb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-675203712&fields=id&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 267 time: 0.0404000
May 26 15:13:01.022110 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-057dd89c-0aa3-4fad-a9d2-746f72293a8a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:01.023495 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-057dd89c-0aa3-4fad-a9d2-746f72293a8a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.1439109
May 26 15:13:01.038094 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-a7cc64f5-aef8-47c5-aa18-057868e74e9e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/quotas/511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 375 time: 0.0092657
May 26 15:13:01.124860 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-520c0821-6dec-44b2-84af-51171e55792c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0819898
May 26 15:13:01.361548 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-4773a1cf-eb5f-4d55-a41a-344f572ec0c6 service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2251859
May 26 15:13:01.490545 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-abf7d76a-5cbb-4280-a687-96b65fa0de2b service neutron] 10.222.0.81 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1226237
May 26 15:13:02.190819 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-c07c9967-19df-4fd4-adae-4074d3ce0db0 req-e72b2ffb-1425-44cd-8407-3d001ac602df tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 210 time: 0.0484920
May 26 15:13:03.343434 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-43e2c625-c47c-43da-9ecd-1b1a97fada54 req-e04dc065-dd8e-4ef6-98ce-1d07448b9b95 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 210 time: 0.0486145
May 26 15:13:04.290526 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-1d780e1a-a79c-4377-986a-7234b1a43368 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:04.291931 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-1d780e1a-a79c-4377-986a-7234b1a43368 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 811 time: 0.2052693
May 26 15:13:04.343284 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-dcc9194a-455a-4cb3-9853-542b26b33231 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=511d07599f124852b029e4bc01cbdd7f HTTP/1.1" status: 200  len: 379 time: 0.0418520
May 26 15:13:04.352590 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'port': {'device_id': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'admin_state_up': True, 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'security_groups': ['1c3a2647-9496-45b8-89c8-8ccb8faa8126']}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:13:04.528957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-8aecee57-ea2b-4e30-bece-add68439c619 req-1a2703fb-235e-44cc-a8ce-ea4d7c1c29a6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 210 time: 0.0570631
May 26 15:13:04.534887 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:13:04.548947 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:13:04.619477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Made reservation on behalf of 511d07599f124852b029e4bc01cbdd7f for: {'port': 1} {{(pid=103982) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 26 15:13:04.622885 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:04.785446 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.20.0.10 (8cb13f82-5501-498d-8d6a-19501eaaa488/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6/04f2a710-48f9-40d2-ad4b-9b24b6e85755) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:13:04.974744 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:04.990743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Transition to ACTIVE for port object 04f2a710-48f9-40d2-ad4b-9b24b6e85755 will not be triggered until provisioned by entity DHCP. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:13:05.061645 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:05.067816 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:05.138563 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:13:05.141705 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:13:05.145836 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:13:05.177317 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:05.198799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.198799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.198799 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.199178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.199409 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.199767 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.200117 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.200470 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.200820 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.201163 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.201506 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.201871 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:05.208489 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.141s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:05.227625 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:05.228385 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:05.348842 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-d7311f77-f026-4e02-aeef-10aa50bf85ac tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.9997783
May 26 15:13:05.363831 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Request body: {'port': {'device_id': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-78414'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:13:05.438303 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-e14f7dd7-ea8c-4e82-99d0-7c5868d3ad7b None None] Provisioning for port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 completed by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:13:05.444032 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-e14f7dd7-ea8c-4e82-99d0-7c5868d3ad7b None None] Provisioning complete for port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 triggered by entity DHCP. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:13:05.444375 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e14f7dd7-ea8c-4e82-99d0-7c5868d3ad7b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:05.478848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:05.505716 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-e14f7dd7-ea8c-4e82-99d0-7c5868d3ad7b None None] Port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 cannot update to ACTIVE because it is not bound. {{(pid=103983) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 26 15:13:05.732397 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-369d5413-af6e-4fa6-a81b-f63de183eb5c req-c0fa72cb-c82d-4d17-9c13-f383eb2a0995 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:05.733804 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-369d5413-af6e-4fa6-a81b-f63de183eb5c req-c0fa72cb-c82d-4d17-9c13-f383eb2a0995 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 932 time: 0.0926876
May 26 15:13:05.780001 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-369d5413-af6e-4fa6-a81b-f63de183eb5c req-d393b493-9ba9-440c-8f96-8337de685975 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399518
May 26 15:13:05.946492 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 04f2a710-48f9-40d2-ad4b-9b24b6e85755 {{(pid=103982) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:13:05.953819 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:05.968308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.provisioning_blocks [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Transition to ACTIVE for port object 04f2a710-48f9-40d2-ad4b-9b24b6e85755 will not be triggered until provisioned by entity L2. {{(pid=103982) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 26 15:13:06.053676 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:06.058369 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-64ccbae1-c699-428c-af63-074d961fe64f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:06.222566 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Pushing event updated for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:06.230715 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:06.297178 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Attempting to bind port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 on host hv-cinder-78414 for vnic_type normal with profile  {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 26 15:13:06.297512 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Attempting to bind port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 by drivers openvswitch,hyperv on host hv-cinder-78414 at level 0 using segments [{'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 26 15:13:06.297867 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Attempting to bind port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:13:06.303070 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-78414 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 26 15:13:06.303388 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Attempting to bind port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 on network 8cb13f82-5501-498d-8d6a-19501eaaa488 {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 26 15:13:06.308695 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Checking agent: {'id': '8378bb7b-3610-4b59-85ed-9e8cac439252', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-78414', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'started_at': datetime.datetime(2021, 5, 26, 14, 55, 57), 'heartbeat_timestamp': datetime.datetime(2021, 5, 26, 15, 12, 59), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 26 15:13:06.308967 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Checking segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103982) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 26 15:13:06.309346 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Bound using segment: {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'} {{(pid=103982) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 26 15:13:06.309871 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.managers [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Bound port: 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host: hv-cinder-78414, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e920f375-6044-42b6-8e5d-20350794e774', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488'}}] {{(pid=103982) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 26 15:13:06.310217 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:06.402673 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, cleared binding levels {{(pid=103982) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 26 15:13:06.405623 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 26 15:13:06.507677 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:06.511654 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-19202068-83d9-4a23-ba66-da446513b56a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:06.570612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:06.571221 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:06.572581 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] 10.222.0.32 "PUT /v2.0/ports/04f2a710-48f9-40d2-ad4b-9b24b6e85755 HTTP/1.1" status: 200  len: 1094 time: 1.2136457
May 26 15:13:06.573105 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:13:06.592573 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Pushing event updated for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=3']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:06.597421 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-98dad5af-bff5-4f77-9dbd-9b672e3fcc94 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:06.633313 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'status': 'completed', 'code': 200}
May 26 15:13:06.731367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-69fff684-11ff-43c5-84e6-59811609b56a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:06.732864 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-69fff684-11ff-43c5-84e6-59811609b56a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1097 time: 0.0781505
May 26 15:13:06.874126 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-c0b9b7f9-48a8-4ee7-9f7f-be07274f2e62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:06.875534 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-c0b9b7f9-48a8-4ee7-9f7f-be07274f2e62 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=511d07599f124852b029e4bc01cbdd7f&shared=False HTTP/1.1" status: 200  len: 913 time: 0.1359136
May 26 15:13:06.971996 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b7a20ff-851d-452d-99df-8f42558c0507 req-6a8410af-1d42-4f8a-b680-57c27a7f4f0e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:06.973491 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b7a20ff-851d-452d-99df-8f42558c0507 req-6a8410af-1d42-4f8a-b680-57c27a7f4f0e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0863168
May 26 15:13:07.018912 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-7b7a20ff-851d-452d-99df-8f42558c0507 req-5362618a-5ffb-4d87-88e2-c2e04fcd42fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391037
May 26 15:13:07.027474 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-062f8fda-e699-4e9e-923c-6a21afbad568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:07.028928 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-062f8fda-e699-4e9e-923c-6a21afbad568 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 871 time: 0.1472411
May 26 15:13:07.132858 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-37e98148-d7b8-4de9-b205-17497b101bcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:07.134348 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-37e98148-d7b8-4de9-b205-17497b101bcd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1097 time: 0.0702009
May 26 15:13:07.204559 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-6f12ae4b-cc15-4d9d-98f1-ca04dc5f0309 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755 HTTP/1.1" status: 200  len: 217 time: 0.0630965
May 26 15:13:07.264864 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-ee1cf97a-66b4-4899-846b-7dae0ebcf5c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:07.266278 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-ee1cf97a-66b4-4899-846b-7dae0ebcf5c8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0556850
May 26 15:13:07.342585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-4344ddff-e77b-4868-ab8b-c1149351c3ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:07.344001 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-4344ddff-e77b-4868-ab8b-c1149351c3ea service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0714848
May 26 15:13:07.475882 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-17a8fd17-7ce7-457e-89f1-a740e21fe09f service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1252878
May 26 15:13:07.701071 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 req-9fb37251-5fb1-4e46-9f4f-05111495ee6e service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2191679
May 26 15:13:08.211643 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2a751-5aca-4578-9644-0c3020f75192 req-d03e6e1a-0cd6-4a61-aab2-f13fbc898d6a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:08.212338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-13c2a751-5aca-4578-9644-0c3020f75192 req-d03e6e1a-0cd6-4a61-aab2-f13fbc898d6a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:13:08.299585 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-13c2a751-5aca-4578-9644-0c3020f75192 req-d03e6e1a-0cd6-4a61-aab2-f13fbc898d6a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:13:08.300668 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-13c2a751-5aca-4578-9644-0c3020f75192 req-d03e6e1a-0cd6-4a61-aab2-f13fbc898d6a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.1771181
May 26 15:13:08.345739 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-13c2a751-5aca-4578-9644-0c3020f75192 req-11f01e6d-8c29-4092-9fdf-7d36e9091208 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393255
May 26 15:13:09.528356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 req-1ad938db-3069-4348-b086-b458d7e2cbcc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:09.529824 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 req-1ad938db-3069-4348-b086-b458d7e2cbcc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0792263
May 26 15:13:09.574332 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 req-d5738b2c-6617-4550-9f50-89d56b6b23a7 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0388153
May 26 15:13:10.760191 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca82cddb-937f-4749-a703-fd425ba526f1 req-90e7f2b5-c28c-40f9-ad83-1fd5b74066a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:10.761648 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca82cddb-937f-4749-a703-fd425ba526f1 req-90e7f2b5-c28c-40f9-ad83-1fd5b74066a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0843360
May 26 15:13:10.806031 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-ca82cddb-937f-4749-a703-fd425ba526f1 req-eb7595b6-9c93-4e1e-801e-efc10456009c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0387444
May 26 15:13:11.448831 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-57b4d016-ef27-476d-bbe6-42e16bf8c54f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0689545
May 26 15:13:11.589050 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2deb0059-8872-4730-b25e-6879e72ff742 req-e362feb1-0546-4ed5-8507-474336841919 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:11.590550 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-e362feb1-0546-4ed5-8507-474336841919 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0746808
May 26 15:13:11.731785 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2deb0059-8872-4730-b25e-6879e72ff742 req-ee8728d8-56d4-47ce-8da6-0ca5aa67a694 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:11.733209 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-ee8728d8-56d4-47ce-8da6-0ca5aa67a694 service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1242907
May 26 15:13:11.836823 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-3ceaac1c-1e11-48d3-a356-abff6b4e743e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 1001 time: 0.0968432
May 26 15:13:11.899761 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2deb0059-8872-4730-b25e-6879e72ff742 req-008e8dd3-f7af-4174-9c82-2972e2b9e3b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:11.901180 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-008e8dd3-f7af-4174-9c82-2972e2b9e3b4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0581050
May 26 15:13:11.981096 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2deb0059-8872-4730-b25e-6879e72ff742 req-4677ea60-ab5e-4fe7-ba6f-ab63d813f827 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:11.982666 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-4677ea60-ab5e-4fe7-ba6f-ab63d813f827 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0745516
May 26 15:13:11.993346 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7e5528-d594-441f-8ae6-f0c7306582f5 req-10e985cb-ced8-4a88-bc49-f6455aae7488 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:11.994818 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c7e5528-d594-441f-8ae6-f0c7306582f5 req-10e985cb-ced8-4a88-bc49-f6455aae7488 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0845077
May 26 15:13:12.040841 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-8c7e5528-d594-441f-8ae6-f0c7306582f5 req-55d1217d-2814-4bc9-aefc-3a26b9663f9c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0401964
May 26 15:13:12.115473 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-8d40bac0-0a90-43c6-998b-1e7ca7a8ed5c service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1255839
May 26 15:13:12.249111 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2deb0059-8872-4730-b25e-6879e72ff742 req-7b6a6558-fadf-457a-a076-bdb7ff33573c service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1265764
May 26 15:13:13.224237 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 req-1a0518b1-3660-4a25-b22c-aa507c4f3e45 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:13.225712 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 req-1a0518b1-3660-4a25-b22c-aa507c4f3e45 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0795622
May 26 15:13:13.270999 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 req-4039d486-9dbb-4238-a6c6-22ce404f18a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0397058
May 26 15:13:13.746439 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 req-277f5338-a806-4671-80af-28347f5bc3e2 service neutron] (103981) timed out ('10.222.0.32', 54787) {{(pid=103981) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 26 15:13:14.371130 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 04f2a710-48f9-40d2-ad4b-9b24b6e85755 details requested by agent hyperv_hv-cinder-78414 with host hv-cinder-78414 {{(pid=103983) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 26 15:13:14.455636 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca575c11-2746-43cc-ae48-bff99d32ccec req-0465a3e2-726c-47d2-8976-778ea92498e8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:14.457164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ca575c11-2746-43cc-ae48-bff99d32ccec req-0465a3e2-726c-47d2-8976-778ea92498e8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 944 time: 0.0806262
May 26 15:13:14.504874 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:13:14.507392 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ca575c11-2746-43cc-ae48-bff99d32ccec req-2aaec610-f7b4-4d1e-9aee-0971316e4857 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441594
May 26 15:13:14.518476 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Returning: {'device': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'port_id': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'mac_address': 'fa:16:3e:66:40:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1246, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103983) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 26 15:13:14.575293 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:14.592735 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 04f2a710-48f9-40d2-ad4b-9b24b6e85755 {{(pid=103983) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 26 15:13:14.608871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:13:14.672387 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:14.674174 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-2f9603a7-0a48-4c76-9054-322971ee73fc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:14.741432 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=4']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:14.748561 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.748913 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.749255 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.749616 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.749951 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.750286 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.750609 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.750938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.751263 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.751592 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.751914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.752309 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:13:14.756110 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:14.946253 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] get_ports_and_sgs() called for port_ids ['04f2a710-48f9-40d2-ad4b-9b24b6e85755'] {{(pid=103983) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 26 15:13:15.695830 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3f7c476-93ba-413a-aadc-94f710db6665 req-a6a57c19-f622-43a1-af33-c498ae012037 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:15.697231 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b3f7c476-93ba-413a-aadc-94f710db6665 req-a6a57c19-f622-43a1-af33-c498ae012037 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 945 time: 0.0875108
May 26 15:13:15.743401 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b3f7c476-93ba-413a-aadc-94f710db6665 req-b4f0fc93-24b2-4353-950a-088549e6e67b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0404024
May 26 15:13:16.386658 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 04f2a710-48f9-40d2-ad4b-9b24b6e85755 up at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 26 15:13:16.545013 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning for port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 completed by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 26 15:13:16.550291 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.provisioning_blocks [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Provisioning complete for port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 triggered by entity L2. {{(pid=103983) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 26 15:13:16.550671 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-857589'] for port, provisioning_complete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:16.667718 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:16.693985 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755'}] {{(pid=103983) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:13:16.707556 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:13:16.738315 dv-cinder-784140-4-iscsi neutron-server[103983]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'code': 200}
May 26 15:13:16.769718 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230'] for port, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:16.771546 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-1dbc0bca-6a5a-4af2-9df3-219db1904f8e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:16.837582 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Pushing event updated for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=5']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:16.840563 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:16.928488 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-489bead2-bca8-427e-acb9-0ec8da13dab9 req-fa0ac8d7-6be1-4f38-abd7-8bdeb91e8bb3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:16.929972 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-489bead2-bca8-427e-acb9-0ec8da13dab9 req-fa0ac8d7-6be1-4f38-abd7-8bdeb91e8bb3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.0805764
May 26 15:13:16.975682 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-489bead2-bca8-427e-acb9-0ec8da13dab9 req-52dce6f5-c119-4f41-b697-eaeee4e7659e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0399759
May 26 15:13:17.106237 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd8a104a-4160-4cdf-93b0-94f90323360d req-55d9f0a4-975c-4d93-9f98-6ca76f549045 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:17.107600 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cd8a104a-4160-4cdf-93b0-94f90323360d req-55d9f0a4-975c-4d93-9f98-6ca76f549045 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1099 time: 0.0750606
May 26 15:13:17.148920 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-cd8a104a-4160-4cdf-93b0-94f90323360d req-82626a31-0cbb-43fc-8827-722bd870054e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0344555
May 26 15:13:18.163805 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 req-708a9cba-4965-4ca0-86c9-ceea922c7aaa tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:18.165255 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 req-708a9cba-4965-4ca0-86c9-ceea922c7aaa tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.0805449
May 26 15:13:18.209029 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 req-77d4e9df-8c40-4242-854b-0258ce1dac22 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0381291
May 26 15:13:18.394579 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c req-4074cc49-6b4b-4639-9213-b91156234092 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:18.396180 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c req-4074cc49-6b4b-4639-9213-b91156234092 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.0823088
May 26 15:13:18.440986 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c req-bf8d34e1-8cca-47d7-8b5c-ef6250759cc2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0393071
May 26 15:13:18.464795 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37616) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:13:18.537438 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0c3e96f-4298-4ff9-861b-e1e71cb70d79 tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:18.538937 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-b0c3e96f-4298-4ff9-861b-e1e71cb70d79 tempest-TestVolumeBootPattern-1830237996 tempest-TestVolumeBootPattern-1830237996-project-admin] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1094 time: 0.0732088
May 26 15:13:18.541721 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37620) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:13:18.546586 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.v2.base [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Request body: {'floatingip': {'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'port_id': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address': '172.20.0.10'}} {{(pid=103982) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 26 15:13:18.552923 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 26 15:13:18.556706 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Usage tracker for resource:floatingip and tenant:511d07599f124852b029e4bc01cbdd7f is out of sync, need to count used quota {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 26 15:13:18.559517 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=103982) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 26 15:13:18.565755 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.quota.driver [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=103982) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 26 15:13:18.631908 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:18.855367 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:18.990159 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.db_base_plugin_common [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Allocated IP 172.27.2.125 (0090f6f3-94b8-4606-8d1e-abbe36685c7a/1d967d29-3b15-482f-9d0a-3caaa5236973/171de2a0-d669-46be-a6f9-5466aa2fcdab) {{(pid=103982) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 26 15:13:19.134724 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:19.249665 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8781805021651', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:19.253500 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-2ee4fc11-ac0c-4b32-a4da-edd667b805b8 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:19.314477 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Network 0090f6f3-94b8-4606-8d1e-abbe36685c7a is already hosted by enough agents. {{(pid=103982) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 26 15:13:19.317254 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.base_scheduler [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Resources bound (agent type, host, resource id):  {{(pid=103982) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 26 15:13:19.320939 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Received port after_create {{(pid=103982) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 26 15:13:19.356491 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=171de2a0-d669-46be-a6f9-5466aa2fcdab,revision_number=1']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:19.368238 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:19.737322 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_create {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:19.878395 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770363'] for port, before_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:20.100851 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for port, precommit_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:20.197758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8781805455243', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8781805021669', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8781805022230', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2528834'] for port, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:20.202424 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-077339ff-186d-4244-9cab-878ffe4187f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:13:20.309661 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event updated for resources: {'Port': ['ID=171de2a0-d669-46be-a6f9-5466aa2fcdab,revision_number=2']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:13:20.313771 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:13:20.318853 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3927784'] for floatingip, after_update {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:20.495145 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 2f847833-f444-493f-a783-1ee43daa0ec7 associated. External IP: 172.27.2.125, port: 04f2a710-48f9-40d2-ad4b-9b24b6e85755.
May 26 15:13:20.499311 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-83e5b887-a1d2-4635-b859-89cf51674aa1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:20.941277 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:13:21.121350 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:13:21.132974 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:13:21.147811 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:13:21.148429 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabff9aaf0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:12:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:13:21.242013 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:21.313265 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-ea129edf-314e-4639-a132-62e9f6afcca2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.7558706
May 26 15:13:21.313265 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:13:21.322158 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:13:21.344216 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'status': 'completed', 'code': 200}
May 26 15:13:21.443574 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-fc7b29f8-c577-4612-88f8-1159aead98ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:21.445059 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-fc7b29f8-c577-4612-88f8-1159aead98ad service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1099 time: 0.0775890
May 26 15:13:21.583353 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-6569a2d9-1fd9-4f39-ab3a-e97a9e5b4a2c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:21.584796 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-6569a2d9-1fd9-4f39-ab3a-e97a9e5b4a2c service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1336167
May 26 15:13:21.687052 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-14acc6b2-4362-43d6-ba8a-2f90a07c51a2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755 HTTP/1.1" status: 200  len: 1000 time: 0.0944846
May 26 15:13:21.721649 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabff9aaf0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}, {'id': '2f847833-f444-493f-a783-1ee43daa0ec7', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:66:40:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:13:19Z', 'updated_at': '2021-05-26T15:13:19Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:13:21.725608 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:13:21.733800 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:13:21.734403 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcabff9aaf0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:12:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:13:21.753598 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-0924aa47-05d3-4b78-b767-f7e64e18007b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:21.755045 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-0924aa47-05d3-4b78-b767-f7e64e18007b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0612693
May 26 15:13:21.830331 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-98637d67-8225-483b-a523-70b71e912959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:13:21.831781 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-98637d67-8225-483b-a523-70b71e912959 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0701230
May 26 15:13:21.911537 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:13:21.966427 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-6224e319-704b-4012-a8ce-c0292edbdf24 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1276505
May 26 15:13:22.101058 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-5a00b272-8951-43f3-9a2e-e548efc29c4a service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1280472
May 26 15:13:22.258742 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcabff9aaf0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}, {'id': '2f847833-f444-493f-a783-1ee43daa0ec7', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:66:40:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:13:19Z', 'updated_at': '2021-05-26T15:13:19Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:13:22.262702 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53176eb1-7851-46d8-88c8-5b9eeda20a24 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}, {'id': '2f847833-f444-493f-a783-1ee43daa0ec7', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.125', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 687, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:66:40:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:13:19Z', 'updated_at': '2021-05-26T15:13:19Z', 'revision_number': 0, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:13:22.463053 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eec85950-d936-470d-9b33-bbea06e11b5b None None] New status for floating IP 2f847833-f444-493f-a783-1ee43daa0ec7: ACTIVE {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:13:23.112934 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:23.169057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-beedf7cb-20c3-486e-a564-af89d0458b7c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:24.117473 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:24.274659 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:13:25.665925 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:29.527298 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:50.497611 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-9076651d-fa0f-4255-a386-b7d519d14738 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:53.143448 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:53.166057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b930e6c7-96cd-4ddd-92d8-7f55863e1984 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:54.109076 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:55.681682 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:13:59.521599 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:01.274374 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:14:11.474095 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-aa5c85fe-c98a-497d-9f35-620f34102ffc service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1122422
May 26 15:14:11.608378 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-50abdbe8-0212-4bee-b92a-6bd9a37e04d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:11.609884 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-50abdbe8-0212-4bee-b92a-6bd9a37e04d1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0690675
May 26 15:14:11.847300 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-186b1fad-6ffa-45f4-bcdb-777e0724a76c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:11.848716 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-186b1fad-6ffa-45f4-bcdb-777e0724a76c service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.2204986
May 26 15:14:11.953406 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-d0caa3cc-f1d8-4818-bd55-4ad2bffdc9d6 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 1001 time: 0.0975277
May 26 15:14:12.018310 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-977f367a-951d-48c6-9dee-e42630f505a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:12.019690 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-977f367a-951d-48c6-9dee-e42630f505a2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0605049
May 26 15:14:12.094124 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-1d813ca8-e43f-492a-8dfd-3d27af8e8081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:12.095563 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-1d813ca8-e43f-492a-8dfd-3d27af8e8081 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0684712
May 26 15:14:12.227235 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-d54bfa2f-0207-467d-a8d5-ea822a7e2c15 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1235621
May 26 15:14:12.357066 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a088b815-e62b-414d-b8b4-8fc8aa5e3166 req-56ee814c-fb24-458d-81b5-66b15cccca03 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1227908
May 26 15:14:20.480491 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-3729e902-4bfd-4eb2-837e-c9471936ce33 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:23.114507 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:23.171660 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cef068ba-d708-465a-9b14-a947bb536974 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:24.103313 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:25.686026 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:29.532203 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:38.273055 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:14:50.506632 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-4e1bfd81-a65c-498b-a452-f8dbe8e76a27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:52.471535 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37646) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:14:52.739074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port 171de2a0-d669-46be-a6f9-5466aa2fcdab {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:14:52.739314 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:52.853484 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:52.854781 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:52.974720 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for 171de2a0-d669-46be-a6f9-5466aa2fcdab owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:14:53.147623 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:53.216412 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:53.220284 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-10780c68-05a5-4890-baf1-22ef0ed0e27f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:14:53.238871 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a52deb51-41ca-4625-9e9f-1871b159bcaf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:53.264777 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=171de2a0-d669-46be-a6f9-5466aa2fcdab,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:14:53.296803 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.297160 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.297526 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.298550 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.298907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.299263 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.299617 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.299978 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.300333 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.300683 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.301028 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.301373 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103982) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:14:53.308642 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:14:53.368229 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:53.368559 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 2f847833-f444-493f-a783-1ee43daa0ec7 disassociated (deleted). External IP: 172.27.2.125, port: 04f2a710-48f9-40d2-ad4b-9b24b6e85755.
May 26 15:14:53.822726 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:14:54.030135 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:14:54.040141 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:14:54.059701 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:14:54.060292 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac45a3580>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:14:54.106419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:54.165874 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-9c1fa023-b50e-4088-988c-30997a320f9b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /v2.0/floatingips/2f847833-f444-493f-a783-1ee43daa0ec7 HTTP/1.1" status: 204  len: 168 time: 1.6930754
May 26 15:14:54.166730 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:14:54.198644 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:54.243037 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:14:54.292957 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'status': 'completed', 'code': 200}
May 26 15:14:54.394024 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-15fc0ec0-c13d-4536-ba09-86c2b99af24f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:54.395491 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-15fc0ec0-c13d-4536-ba09-86c2b99af24f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 1099 time: 0.0797660
May 26 15:14:54.534116 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-129d8332-75df-451d-8b13-50eb084f4576 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:54.535569 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-129d8332-75df-451d-8b13-50eb084f4576 service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1336486
May 26 15:14:54.613461 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-5068b396-4c0b-4cd5-965c-8a690d064769 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755 HTTP/1.1" status: 200  len: 217 time: 0.0689232
May 26 15:14:54.649212 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac45a3580>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:14:54.653175 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:14:54.662883 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:14:54.663652 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac45a3580>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:14:54.690220 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-ccba4f24-c0e1-4b1f-8b05-a5708dd33b11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:54.691655 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-ccba4f24-c0e1-4b1f-8b05-a5708dd33b11 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0643504
May 26 15:14:54.774897 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-6d3bc496-b7b5-4e10-92d6-97730e261326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:54.776472 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-6d3bc496-b7b5-4e10-92d6-97730e261326 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0774407
May 26 15:14:54.846923 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:14:54.848195 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 req-eafea57f-07e1-4057-a692-2e837ddbdb5e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:54.849693 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 req-eafea57f-07e1-4057-a692-2e837ddbdb5e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.1329396
May 26 15:14:54.897408 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 req-18a3c83c-c4fb-40f2-8504-0daa467f707b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419044
May 26 15:14:54.919613 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-4872b746-7b70-4c21-b264-8b2427c37ea4 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1356184
May 26 15:14:55.052717 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-225a526c-dd67-4dfa-a445-4bbe2a5b2e8e service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252491
May 26 15:14:55.192971 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac45a3580>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:14:55.196840 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feca7237-ded0-4a9d-ab03-428a33dbf6e2 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_floatingips': [{'id': '275c3687-5bbc-49dc-9c23-c571b59616a0', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'floating_ip_address': '172.27.2.162', 'floating_network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'router_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'port_id': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 684, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'mac_address': 'fa:16:3e:98:ee:78', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-26T15:11:11Z', 'updated_at': '2021-05-26T15:11:13Z', 'revision_number': 1, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:14:55.410053 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97c5b430-3671-4be2-90a8-94a423c168c4 None None] New status for floating IP 2f847833-f444-493f-a783-1ee43daa0ec7: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:14:55.690183 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:56.130340 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236cef94-c436-4f67-9264-d409f150e359 req-7cf7add9-b5ed-4266-9712-d0c8372c16be tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:56.131017 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-236cef94-c436-4f67-9264-d409f150e359 req-7cf7add9-b5ed-4266-9712-d0c8372c16be tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:14:56.220452 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-4e6e2ec0-b91b-4076-87da-c7d737b432bf tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:14:56.221054 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-4e6e2ec0-b91b-4076-87da-c7d737b432bf tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:14:56.239814 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-236cef94-c436-4f67-9264-d409f150e359 req-7cf7add9-b5ed-4266-9712-d0c8372c16be tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:14:56.240999 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-236cef94-c436-4f67-9264-d409f150e359 req-7cf7add9-b5ed-4266-9712-d0c8372c16be tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.2336090
May 26 15:14:56.241988 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-4e6e2ec0-b91b-4076-87da-c7d737b432bf tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:14:56.242970 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-4e6e2ec0-b91b-4076-87da-c7d737b432bf tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 946 time: 0.1083851
May 26 15:14:56.481454 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-236cef94-c436-4f67-9264-d409f150e359 req-134330ce-c2ce-4655-a867-736523e60f7d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2346234
May 26 15:14:56.519338 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:14:56.519678 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:56.654414 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] For port 04f2a710-48f9-40d2-ad4b-9b24b6e85755, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=04f2a710-48f9-40d2-ad4b-9b24b6e85755,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:14:56.654765 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:56.777434 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for 04f2a710-48f9-40d2-ad4b-9b24b6e85755 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:14:56.999110 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:57.004602 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-22606d69-c846-42e7-9742-4a0275792467 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:14:57.047971 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=04f2a710-48f9-40d2-ad4b-9b24b6e85755,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:14:57.051475 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:14:57.125909 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] No DVR routers for this DVR port 04f2a710-48f9-40d2-ad4b-9b24b6e85755 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:14:57.128347 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:14:57.130842 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'name': 'network-vif-deleted', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:14:57.190643 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dfa8229d-e902-4b9b-a5ab-dd5fbd83964b', 'name': 'network-vif-deleted', 'tag': '04f2a710-48f9-40d2-ad4b-9b24b6e85755', 'status': 'completed', 'code': 200}
May 26 15:14:57.204902 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-a5062f1d-ae83-4264-bdd9-a44fe716f44d req-34f32450-38e1-4e2c-8080-569ff7aa51af tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "DELETE /v2.0/ports/04f2a710-48f9-40d2-ad4b-9b24b6e85755 HTTP/1.1" status: 204  len: 173 time: 0.9563320
May 26 15:14:57.635612 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0ce1c522-01bf-42f5-aa1c-66baba2535dd req-2735319b-80eb-45a1-ae2f-52f7eea334f4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:14:57.736659 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-0ce1c522-01bf-42f5-aa1c-66baba2535dd req-2735319b-80eb-45a1-ae2f-52f7eea334f4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:14:57.737875 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-0ce1c522-01bf-42f5-aa1c-66baba2535dd req-2735319b-80eb-45a1-ae2f-52f7eea334f4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=dfa8229d-e902-4b9b-a5ab-dd5fbd83964b HTTP/1.1" status: 200  len: 210 time: 0.1467083
May 26 15:14:58.897012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 04f2a710-48f9-40d2-ad4b-9b24b6e85755 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:14:58.934258 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: 04f2a710-48f9-40d2-ad4b-9b24b6e85755 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:14:58.934610 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device 04f2a710-48f9-40d2-ad4b-9b24b6e85755 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:14:59.569951 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:01.502551 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37684) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:01.766758 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port bb77c64d-f35b-47ee-bbab-b3f67675e5da {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:01.767013 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:01.883376 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:01.883703 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:02.005159 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for bb77c64d-f35b-47ee-bbab-b3f67675e5da owned by network:floatingip {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:02.170302 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:02.178119 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-8630a4b5-1aeb-46b9-bc02-eb3d89ac3f63 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:02.226466 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=bb77c64d-f35b-47ee-bbab-b3f67675e5da,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:02.252267 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:02.318843 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:02.319169 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.db.l3_db [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Floating IP 275c3687-5bbc-49dc-9c23-c571b59616a0 disassociated (deleted). External IP: 172.27.2.162, port: e19df163-9d36-4b27-a614-a95afeeb27c6.
May 26 15:15:02.773164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:15:02.957513 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:15:02.966865 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:15:02.977258 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:02.980250 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4243eb0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:03.049490 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:03.104201 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /v2.0/floatingips/275c3687-5bbc-49dc-9c23-c571b59616a0 HTTP/1.1" status: 204  len: 168 time: 1.6004872
May 26 15:15:03.104825 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:15:03.151472 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'status': 'completed', 'code': 200}
May 26 15:15:03.155695 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:03.248990 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-fe9f3222-25c6-4a87-a71b-cc455fd3e38d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:03.250553 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-fe9f3222-25c6-4a87-a71b-cc455fd3e38d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=511d07599f124852b029e4bc01cbdd7f&device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 1098 time: 0.0762491
May 26 15:15:03.396388 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-515d6a6d-aaab-4fc1-82e2-04b814a4a4fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:03.398008 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-515d6a6d-aaab-4fc1-82e2-04b814a4a4fa service neutron] 10.222.0.32 "GET /v2.0/networks?id=8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 200  len: 913 time: 0.1405511
May 26 15:15:03.478380 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4243eb0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:03.482434 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:15:03.484466 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-9bab6365-a373-443f-be8f-df45fd876fcf service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 200  len: 217 time: 0.0765913
May 26 15:15:03.491559 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:03.492148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac4243eb0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:03.551793 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-7283ecce-28d0-46cd-b4d3-dc6a8f387870 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:03.553235 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-7283ecce-28d0-46cd-b4d3-dc6a8f387870 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 200  len: 850 time: 0.0630274
May 26 15:15:03.632002 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-206b7c1f-355a-469d-bed3-125826c319e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:03.633733 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-206b7c1f-355a-469d-bed3-125826c319e4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=8cb13f82-5501-498d-8d6a-19501eaaa488&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0732787
May 26 15:15:03.715727 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:03.733079 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 req-e5cda469-808d-4182-965c-9e3ddeec4332 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103981) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:03.734829 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 req-e5cda469-808d-4182-965c-9e3ddeec4332 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.0858648
May 26 15:15:03.775634 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-6dbccfd0-2cab-491c-98e9-f492a5e5c649 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1349037
May 26 15:15:03.785063 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 req-b7a1bba4-8c7d-45b3-8c81-334983f9c59d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0440767
May 26 15:15:03.910440 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-28da2e46-8cf1-4340-b258-e8c21f18aaa3 service neutron] 10.222.0.32 "GET /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1268060
May 26 15:15:04.028102 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac4243eb0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:04.032091 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00917b0f-7e7c-4a04-a21f-47ac555b30ba None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:07:53Z', 'revision_number': 4, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi', '_interfaces': [{'id': 'd89827f6-2ccb-4bd9-a079-83aff0cb1f5e', 'name': '', 'network_id': '8cb13f82-5501-498d-8d6a-19501eaaa488', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'mac_address': 'fa:16:3e:6d:f1:4c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:53Z', 'updated_at': '2021-05-26T15:08:00Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'subnets': [{'id': 'd1f7e853-f6e7-4c96-9ca2-6e0a401577d6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:15:04.227485 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9803ff55-703c-4bb3-a6b3-719b52fe8f91 None None] New status for floating IP 275c3687-5bbc-49dc-9c23-c571b59616a0: DOWN {{(pid=103984) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 26 15:15:04.971907 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b164e4da-9d57-423e-a491-be96f89c3dc5 req-4a18ac64-7ad2-49f7-bc4d-840969b3083a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:04.972591 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-b164e4da-9d57-423e-a491-be96f89c3dc5 req-4a18ac64-7ad2-49f7-bc4d-840969b3083a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:15:05.071401 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-b164e4da-9d57-423e-a491-be96f89c3dc5 req-4a18ac64-7ad2-49f7-bc4d-840969b3083a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:15:05.072414 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b164e4da-9d57-423e-a491-be96f89c3dc5 req-4a18ac64-7ad2-49f7-bc4d-840969b3083a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.1790278
May 26 15:15:05.132148 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-b164e4da-9d57-423e-a491-be96f89c3dc5 req-e3be2efe-d336-4f67-9f0f-8ce06031e207 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/security-groups?id=1c3a2647-9496-45b8-89c8-8ccb8faa8126&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0526931
May 26 15:15:05.150419 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-859099ee-5199-4d20-a9c5-05d650aad642 req-a4b03709-f48d-4de9-89b6-74c0efc5d9dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103982) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 26 15:15:05.151843 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-859099ee-5199-4d20-a9c5-05d650aad642 req-a4b03709-f48d-4de9-89b6-74c0efc5d9dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 945 time: 0.1190734
May 26 15:15:05.382543 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port e19df163-9d36-4b27-a614-a95afeeb27c6 {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:05.382891 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:05.516362 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] For port e19df163-9d36-4b27-a614-a95afeeb27c6, host hv-cinder-78414, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-78414',level=0,port_id=e19df163-9d36-4b27-a614-a95afeeb27c6,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:05.516788 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:05.639164 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for e19df163-9d36-4b27-a614-a95afeeb27c6 owned by compute:nova {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:05.821681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:05.828494 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-7656778c-8f83-4775-af69-cdd24734bac0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:05.899562 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=e19df163-9d36-4b27-a614-a95afeeb27c6,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:05.906853 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:05.950074 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.db.l3_dvrscheduler_db [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] No DVR routers for this DVR port e19df163-9d36-4b27-a614-a95afeeb27c6 on host hv-cinder-78414 {{(pid=103982) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:15:05.952433 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for port, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:05.955121 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'name': 'network-vif-deleted', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6'}] {{(pid=103982) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 26 15:15:05.999408 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fcd7d41b-b99b-4502-9ab8-7d51564e17a0', 'name': 'network-vif-deleted', 'tag': 'e19df163-9d36-4b27-a614-a95afeeb27c6', 'status': 'completed', 'code': 200}
May 26 15:15:06.022065 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-859099ee-5199-4d20-a9c5-05d650aad642 req-ae70e819-6ba6-4e7d-8763-47acdcb46983 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.32 "DELETE /v2.0/ports/e19df163-9d36-4b27-a614-a95afeeb27c6 HTTP/1.1" status: 204  len: 173 time: 0.8642547
May 26 15:15:06.284881 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 req-5454c2e3-6d62-4435-ab12-6f45630cf99f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Synchronizing usage tracker for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 26 15:15:06.353191 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.quota.resource [req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 req-5454c2e3-6d62-4435-ab12-6f45630cf99f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Unset dirty status for tenant:511d07599f124852b029e4bc01cbdd7f on resource:port {{(pid=103982) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 26 15:15:06.354429 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 req-5454c2e3-6d62-4435-ab12-6f45630cf99f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /v2.0/ports?device_id=fcd7d41b-b99b-4502-9ab8-7d51564e17a0 HTTP/1.1" status: 200  len: 210 time: 0.1124766
May 26 15:15:07.452401 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37702) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:07.678335 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Deleting port f7880de0-c1ec-499a-83e8-caf76af59eb9 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:07.678588 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:07.798356 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:07.798684 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:07.917980 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling delete_port for f7880de0-c1ec-499a-83e8-caf76af59eb9 owned by network:floatingip {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:08.084097 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:08.087679 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1c7af8d8-0f59-440a-8407-9c13de66cdf8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:08.133691 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'Port': ['ID=f7880de0-c1ec-499a-83e8-caf76af59eb9,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:08.171091 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.171460 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.171918 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.172397 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.172754 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.173162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.173512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.173884 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.174229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.174576 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.174915 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.175253 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103981) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:08.182153 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:08.234096 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for floatingip, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:08.305800 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-502807'] for floatingip, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:08.306955 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-c61d7e43-22a4-45e1-b703-073358371fe5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /v2.0/floatingips/00c68e1a-4f21-4cb9-a44a-89f11128a98e HTTP/1.1" status: 204  len: 168 time: 0.8535783
May 26 15:15:08.927435 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e19df163-9d36-4b27-a614-a95afeeb27c6 no longer exists at agent hyperv_hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:08.964730 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] No Port match for: e19df163-9d36-4b27-a614-a95afeeb27c6 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:08.965072 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Device e19df163-9d36-4b27-a614-a95afeeb27c6 not bound to the agent host hv-cinder-78414 {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:09.788938 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37716) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:09.860067 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:09.981151 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:10.164388 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:10.168171 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-286b2820-4522-4369-95a9-eaf21406e5a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:10.183512 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c3a2647-9496-45b8-89c8-8ccb8faa8126,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:10.185943 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:10.259947 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:10.261084 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-aba1cf3f-8823-45a4-8526-b3b4927ca83d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /v2.0/security-groups/1c3a2647-9496-45b8-89c8-8ccb8faa8126 HTTP/1.1" status: 204  len: 168 time: 0.4711504
May 26 15:15:10.387766 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37722) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:11.041049 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:11.560535 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Deleting port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:11.561115 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:11.683009 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] For port d89827f6-2ccb-4bd9-a079-83aff0cb1f5e, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:11.683363 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:11.808205 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Calling delete_port for d89827f6-2ccb-4bd9-a079-83aff0cb1f5e owned by network:router_interface {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:12.158580 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:12.162328 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-57753440-71a7-4b68-aeb1-f791bb24e03b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:12.209868 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Pushing event deleted for resources: {'Port': ['ID=d89827f6-2ccb-4bd9-a079-83aff0cb1f5e,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:12.212959 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:12.474857 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:12.939743 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103982) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:15:13.115571 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103982) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:15:13.124510 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Sync routers for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:15:13.127615 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-03ccd6da-bc7f-4cfe-bbe8-0a6c43250e83 admin admin] 10.222.0.81 "PUT /v2.0/routers/adc8aa9d-fb80-48f3-8d70-86ae33a2c804/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7387922
May 26 15:15:13.130218 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37728) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:13.133919 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:13.134544 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46624c0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:13.305686 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks [] for router, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:13.310191 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: dv-cinder-784140-4-iscsi {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:13.489681 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:13.610581 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46624c0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95'}], 'enable_snat': True}, 'gw_port_id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:15:12Z', 'revision_number': 5, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port': {'id': 'f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:4e:3e:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'device_owner': 'network:router_gateway', 'standard_attr_id': 656, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.95', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:50Z', 'updated_at': '2021-05-26T15:07:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:13.614367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Checking router: adc8aa9d-fb80-48f3-8d70-86ae33a2c804 for host: dv-cinder-784140-4-iscsi {{(pid=103983) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:15:13.622724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Routers {'adc8aa9d-fb80-48f3-8d70-86ae33a2c804'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103983) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:13.623332 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac46624c0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'], 'active': True} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:13.625740 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Deleting port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd {{(pid=103982) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:13.626082 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:13.749303 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.db [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] For port f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103982) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:13.749689 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:13.773084 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvr_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] Set router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 gateway port host: None {{(pid=103983) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:13.876942 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.plugins.ml2.plugin [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Calling delete_port for f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd owned by network:router_gateway {{(pid=103982) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:13.878743 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_hamode_db [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac46624c0>, [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:15:13Z', 'revision_number': 6, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103983) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:13.882666 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96bb905-a848-4f57-84ee-fe264753f2d9 None None] The sync data for ids ['adc8aa9d-fb80-48f3-8d70-86ae33a2c804'] in dv-cinder-784140-4-iscsi is: [{'id': 'adc8aa9d-fb80-48f3-8d70-86ae33a2c804', 'name': 'tempest-TestVolumeBootPattern-213529867-router', 'tenant_id': '511d07599f124852b029e4bc01cbdd7f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:49Z', 'updated_at': '2021-05-26T15:15:13Z', 'revision_number': 6, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'gw_port_host': None}] {{(pid=103983) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:15:14.078345 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2528885'] for port, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.082007 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-f6f2eb8d-78e3-4f68-bee9-429ac0d4f98e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:14.126188 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Pushing event deleted for resources: {'Port': ['ID=f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:14.129760 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:14.218528 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.493848 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.496223 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.615316 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.615761 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Fanout notify agent at l3_agent the message router_deleted on router adc8aa9d-fb80-48f3-8d70-86ae33a2c804 {{(pid=103982) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:15:14.628080 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] Notify callbacks [] for router, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.629198 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-221ddcdd-9c90-45eb-8c1f-0a07b798f30d admin admin] 10.222.0.81 "DELETE /v2.0/routers/adc8aa9d-fb80-48f3-8d70-86ae33a2c804 HTTP/1.1" status: 204  len: 168 time: 1.4980960
May 26 15:15:14.632165 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37732) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:14.693656 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Deleting subnet d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:15:14.696557 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.750642 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:14.831100 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.152770 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.158131 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5bed2d63-b051-4a10-a453-d9d58256a72f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:15.192922 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d1f7e853-f6e7-4c96-9ca2-6e0a401577d6,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:15.194881 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.198657 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:15.200202 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3a1331f2-e5e9-434a-bb12-9555e0422dc7 None None] Network 8cb13f82-5501-498d-8d6a-19501eaaa488 requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:15:15.201462 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-0920df13-935d-4c78-bc47-95fdb73feb0b admin admin] 10.222.0.81 "DELETE /v2.0/subnets/d1f7e853-f6e7-4c96-9ca2-6e0a401577d6 HTTP/1.1" status: 204  len: 168 time: 0.5680363
May 26 15:15:15.203693 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37736) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:15.272414 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:15:15.311890 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.387115 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Deleting port b4222013-e6de-46e2-bd04-d31df642d3ad {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:15.387452 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.487606 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] For port b4222013-e6de-46e2-bd04-d31df642d3ad, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=b4222013-e6de-46e2-bd04-d31df642d3ad,segment=NetworkSegment(e920f375-6044-42b6-8e5d-20350794e774),segment_id=e920f375-6044-42b6-8e5d-20350794e774)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:15.487958 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.493278 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] DHCP port deletion for 8cb13f82-5501-498d-8d6a-19501eaaa488 request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:15:15.535688 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d89827f6-2ccb-4bd9-a079-83aff0cb1f5e no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:15.582349 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: d89827f6-2ccb-4bd9-a079-83aff0cb1f5e {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:15.582699 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d89827f6-2ccb-4bd9-a079-83aff0cb1f5e not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:15.583125 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:15.618151 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Calling delete_port for b4222013-e6de-46e2-bd04-d31df642d3ad owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:15.624626 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:15.624988 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f5e2f388-b023-4d0f-bcc9-d7eba3b39dcd not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:15.698198 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Deleting port b4222013-e6de-46e2-bd04-d31df642d3ad {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:15.698502 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.706854 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.711718 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-5f2e20cd-dcc6-4833-9aa9-6ee5baa9699e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:15.754756 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Pushing event deleted for resources: {'Port': ['ID=b4222013-e6de-46e2-bd04-d31df642d3ad,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:15.757266 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:15.759815 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] No DVR routers for this DVR port b4222013-e6de-46e2-bd04-d31df642d3ad on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:15:15.817407 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] For port b4222013-e6de-46e2-bd04-d31df642d3ad, host dv-cinder-784140-4-iscsi, got binding levels [] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:15.817826 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.875048 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.887892 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac45e6460>,) {'filters': {'network_id': ['8cb13f82-5501-498d-8d6a-19501eaaa488']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:15.901009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45e6460>, 'e920f375-6044-42b6-8e5d-20350794e774') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:15.901303 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac45e6460>, 'e920f375-6044-42b6-8e5d-20350794e774') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:15.913389 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.928724 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.934558 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Releasing vlan 1246 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:15:15.934927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.940706 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Calling delete_port for b4222013-e6de-46e2-bd04-d31df642d3ad owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:15.946191 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.ipam_backend_mixin [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Port b4222013-e6de-46e2-bd04-d31df642d3ad was not found and therefore no delete operation was performed {{(pid=103983) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:566}}
May 26 15:15:15.953914 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:15:15.954084 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:15:15.956305 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-5be35271-929c-4b15-af0f-1114efe60091 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:16.051632 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Pushing event deleted for resources: {'Port': ['ID=b4222013-e6de-46e2-bd04-d31df642d3ad,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:16.060139 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] No DVR routers for this DVR port b4222013-e6de-46e2-bd04-d31df642d3ad on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:15:16.065008 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.065358 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.065724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.066057 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.066384 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.066710 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.067031 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.067352 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.067674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.067997 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.068313 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.068633 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-784140-4-iscsi {{(pid=103983) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 26 15:15:16.080764 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-bea0ca30-1ec7-46b6-bd3d-c5e850e73234 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:16.100932 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:16.105830 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:16.109443 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:16.133864 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Pushing event deleted for resources: {'Network': ['ID=8cb13f82-5501-498d-8d6a-19501eaaa488,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:16.138257 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:16.215677 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-23bc2678-871b-4baa-a790-25e8855112c8 admin admin] 10.222.0.81 "DELETE /v2.0/networks/8cb13f82-5501-498d-8d6a-19501eaaa488 HTTP/1.1" status: 204  len: 168 time: 1.0109847
May 26 15:15:16.218441 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37740) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:16.840314 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3930874'] for router_interface, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:17.239667 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Deleting port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:17.240004 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:17.358872 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] For port 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:17.359229 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:17.481251 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Calling delete_port for 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b owned by network:router_interface {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:17.505794 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device b4222013-e6de-46e2-bd04-d31df642d3ad no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:17.543662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: b4222013-e6de-46e2-bd04-d31df642d3ad {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:17.544018 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device b4222013-e6de-46e2-bd04-d31df642d3ad not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:17.695337 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:17.699893 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-6ddeb549-6504-45fb-a78b-76786f23b85a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:17.774966 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Pushing event deleted for resources: {'Port': ['ID=1dc71af4-d0ae-4a21-9090-cb285bf6cd6b,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:17.777370 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:18.106908 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3801081', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3926346'] for router_interface, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:18.464543 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Router 2506d6c8-57be-4964-b8b4-1b44199bde3a has already been hosted by L3 agent 8efa38ca-8bb2-434e-a6bd-f98e69de3dea {{(pid=103981) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 26 15:15:18.642305 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] Notify agent at l3_agent.dv-cinder-784140-4-iscsi the message routers_updated {{(pid=103981) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 26 15:15:18.650511 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Sync routers for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 26 15:15:18.660022 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:18.664546 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac50df3a0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:18.731700 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-cba696ea-3070-49ae-a0d9-1fa1ab006da3 admin admin] 10.222.0.81 "PUT /v2.0/routers/2506d6c8-57be-4964-b8b4-1b44199bde3a/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5118401
May 26 15:15:18.733925 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37744) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:18.840089 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: dv-cinder-784140-4-iscsi {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:18.913927 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks [] for router, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:19.081575 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:19.121857 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac50df3a0>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'external_fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209'}], 'enable_snat': True}, 'gw_port_id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:15:17Z', 'revision_number': 5, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port': {'id': 'f9069e38-40c4-4080-b706-fa8d55e31a42', 'name': '', 'network_id': '0090f6f3-94b8-4606-8d1e-abbe36685c7a', 'tenant_id': '', 'mac_address': 'fa:16:3e:66:af:e6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 668, 'fixed_ips': [{'subnet_id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'ip_address': '172.27.2.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-784140-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-26T15:07:58Z', 'updated_at': '2021-05-26T15:08:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '1d967d29-3b15-482f-9d0a-3caaa5236973', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-784140-4-iscsi'}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:19.126260 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Checking router: 2506d6c8-57be-4964-b8b4-1b44199bde3a for host: dv-cinder-784140-4-iscsi {{(pid=103984) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 26 15:15:19.134580 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Routers {'2506d6c8-57be-4964-b8b4-1b44199bde3a'} bound to L3 agent in host dv-cinder-784140-4-iscsi {{(pid=103984) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 26 15:15:19.135156 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7fcac50df3a0>, 'dv-cinder-784140-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-26T14:49:53Z,description=<?>,heartbeat_timestamp=2021-05-26T15:14:53Z,host='dv-cinder-784140-4-iscsi',id=8efa38ca-8bb2-434e-a6bd-f98e69de3dea,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-26T14:49:53Z,topic='l3_agent')) {'router_ids': ['2506d6c8-57be-4964-b8b4-1b44199bde3a'], 'active': True} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:19.240491 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Deleting port f9069e38-40c4-4080-b706-fa8d55e31a42 {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:19.241125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:19.286951 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_dvr_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] Set router 2506d6c8-57be-4964-b8b4-1b44199bde3a gateway port host: None {{(pid=103984) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 26 15:15:19.362124 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] For port f9069e38-40c4-4080-b706-fa8d55e31a42, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=f9069e38-40c4-4080-b706-fa8d55e31a42,segment=NetworkSegment(3911e6c6-a3f2-4d55-9830-82a3b81724ae),segment_id=3911e6c6-a3f2-4d55-9830-82a3b81724ae)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:19.362366 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:19.389463 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.l3_hamode_db [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7fcac50df3a0>, [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:15:19Z', 'revision_number': 6, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port_host': None}], 'dv-cinder-784140-4-iscsi', False) {} {{(pid=103984) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:19.393421 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0356f995-8c55-4452-be99-0d5a588dee1f None None] The sync data for ids ['2506d6c8-57be-4964-b8b4-1b44199bde3a'] in dv-cinder-784140-4-iscsi is: [{'id': '2506d6c8-57be-4964-b8b4-1b44199bde3a', 'name': 'tempest-TestVolumeBootPattern-76928611-router', 'tenant_id': 'a056c271765b428094429bd897256335', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-26T15:07:57Z', 'updated_at': '2021-05-26T15:15:19Z', 'revision_number': 6, 'project_id': 'a056c271765b428094429bd897256335', 'gw_port_host': None}] {{(pid=103984) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 26 15:15:19.604451 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Calling delete_port for f9069e38-40c4-4080-b706-fa8d55e31a42 owned by network:router_gateway {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:19.775565 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:19.798162 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:19.803410 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-d63006ac-ce52-42b7-ae31-909d821a5067 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:19.811211 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:19.811565 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device 1dc71af4-d0ae-4a21-9090-cb285bf6cd6b not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:19.854139 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Pushing event deleted for resources: {'Port': ['ID=f9069e38-40c4-4080-b706-fa8d55e31a42,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:19.879719 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:19.944829 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3927765'] for router_gateway, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.114976 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3921226', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-734'] for router, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.117219 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.231465 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3921510'] for router, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.231967 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2506d6c8-57be-4964-b8b4-1b44199bde3a {{(pid=103981) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 26 15:15:20.244091 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] Notify callbacks [] for router, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.245203 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-20df5ab3-7566-4f08-a0bd-8c631d79925e admin admin] 10.222.0.81 "DELETE /v2.0/routers/2506d6c8-57be-4964-b8b4-1b44199bde3a HTTP/1.1" status: 204  len: 168 time: 1.5102968
May 26 15:15:20.247667 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37748) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:20.310291 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.db_base_plugin_v2 [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Deleting subnet d2eed12b-1853-43c6-9d27-5589deb4b611 {{(pid=103981) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 26 15:15:20.314040 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.368792 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2311919'] for subnet, precommit_delete_associations {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.447406 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-909799'] for subnet, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.523012 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-eb7e8dfe-5775-40af-b3fc-51153c4bf619 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.758316 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-911920', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503185', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2226081', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2161955'] for subnet, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.763361 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-39912726-f9e1-4d5d-9166-72cdab361c0e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:20.800447 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Notify callbacks [] for subnet, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.802871 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d2eed12b-1853-43c6-9d27-5589deb4b611,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:20.803126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b334e868-5bf0-4c73-8e36-4bad1ba46b14 None None] Network dd7efba7-2f11-4123-a08a-0654f156b0cb requested from dv-cinder-784140-4-iscsi {{(pid=103983) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 26 15:15:20.805687 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:20.808427 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-82e5d9a0-ad44-457c-8846-a92c03cb9158 admin admin] 10.222.0.81 "DELETE /v2.0/subnets/d2eed12b-1853-43c6-9d27-5589deb4b611 HTTP/1.1" status: 204  len: 168 time: 0.5598333
May 26 15:15:20.811471 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37752) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:20.918921 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-744051'] for network, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:20.989786 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Deleting port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a {{(pid=103981) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:20.990125 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.037395 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf412306-182f-40d1-88b0-4503995301ec None None] DHCP port deletion for dd7efba7-2f11-4123-a08a-0654f156b0cb request from dv-cinder-784140-4-iscsi {{(pid=103983) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 26 15:15:21.094239 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.db [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] For port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103981) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:21.094598 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.101765 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Deleting port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a {{(pid=103983) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 26 15:15:21.102143 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8781805453132'] for port, before_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.199051 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.db [None req-cf412306-182f-40d1-88b0-4503995301ec None None] For port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a, host dv-cinder-784140-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-784140-4-iscsi',level=0,port_id=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,segment=NetworkSegment(20f963c6-ff4c-42b9-82bd-54a12175ca4f),segment_id=20f963c6-ff4c-42b9-82bd-54a12175ca4f)] {{(pid=103983) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 26 15:15:21.199437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3924233'] for port, precommit_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.217917 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.plugin [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Calling delete_port for d13655ab-e6e9-4827-97a7-ef32fbf2ad7a owned by network:dhcp {{(pid=103981) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:21.353822 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Calling delete_port for d13655ab-e6e9-4827-97a7-ef32fbf2ad7a owned by network:dhcp {{(pid=103983) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 26 15:15:21.362860 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2225488'] for port, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.367734 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-138da926-0c8f-4cb1-8ba7-3a18b6e4828d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:21.397252 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770286', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-503148', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3801067', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8781805455270', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8781805021660'] for port, after_delete {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.401021 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:21.448880 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Pushing event deleted for resources: {'Port': ['ID=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,revision_number=None']} {{(pid=103983) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:21.450592 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf412306-182f-40d1-88b0-4503995301ec None None] No DVR routers for this DVR port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a on host dv-cinder-784140-4-iscsi {{(pid=103983) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:15:21.451965 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG oslo_concurrency.lockutils [None req-cf412306-182f-40d1-88b0-4503995301ec None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=103983) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:21.504331 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Pushing event deleted for resources: {'Port': ['ID=d13655ab-e6e9-4827-97a7-ef32fbf2ad7a,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:21.506181 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] No DVR routers for this DVR port d13655ab-e6e9-4827-97a7-ef32fbf2ad7a on host dv-cinder-784140-4-iscsi {{(pid=103981) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 26 15:15:21.507650 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:21.520517 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f9069e38-40c4-4080-b706-fa8d55e31a42 no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:21.554415 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: f9069e38-40c4-4080-b706-fa8d55e31a42 {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:21.554760 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device f9069e38-40c4-4080-b706-fa8d55e31a42 not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:21.555178 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d13655ab-e6e9-4827-97a7-ef32fbf2ad7a no longer exists at agent ovs-agent-dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 26 15:15:21.588531 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.plugin [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] No Port match for: d13655ab-e6e9-4827-97a7-ef32fbf2ad7a {{(pid=103983) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 26 15:15:21.588875 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron.plugins.ml2.rpc [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Device d13655ab-e6e9-4827-97a7-ef32fbf2ad7a not bound to the agent host dv-cinder-784140-4-iscsi {{(pid=103983) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 26 15:15:21.623757 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-856698', 'neutron.services.segments.db._delete_segments_for_network-8781805467621'] for network, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.636485 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7fcac43c7490>,) {'filters': {'network_id': ['dd7efba7-2f11-4123-a08a-0654f156b0cb']}} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:21.649351 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac43c7490>, '20f963c6-ff4c-42b9-82bd-54a12175ca4f') {'for_net_delete': True} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:21.649676 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.services.segments.db [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7fcac43c7490>, '20f963c6-ff4c-42b9-82bd-54a12175ca4f') {} {{(pid=103981) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 26 15:15:21.661605 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8781805475494', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2311894'] for segment, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.677267 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634'] for segment, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.683184 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Releasing vlan 1210 on physical network physnet1 to pool {{(pid=103981) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 26 15:15:21.683560 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-915634', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2225411'] for segment, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]: Traceback (most recent call last):
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     timer()
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     cb(*args, **kw)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     return func(*args, **kwargs)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     self._notify()
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     self.callback(batched_events)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     event.method(event)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     aggregate_uuid = self.p_client.list_aggregates(
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     return f(self, *a, **k)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._get(url).json()
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     return self.request(url, 'GET', **kwargs)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     base_url = self.get_endpoint(auth, allow=allow,
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 26 15:15:21.696338 dv-cinder-784140-4-iscsi neutron-server[103981]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 26 15:15:21.877091 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-856677', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-4001603', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3801058', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3927802'] for network, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.880593 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:21.894240 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3801029'] for network, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:21.907159 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Pushing event deleted for resources: {'Network': ['ID=dd7efba7-2f11-4123-a08a-0654f156b0cb,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:21.910668 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:21.915963 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-1124bc46-fa75-4d69-bfec-bd79d783b33c admin admin] 10.222.0.81 "DELETE /v2.0/networks/dd7efba7-2f11-4123-a08a-0654f156b0cb HTTP/1.1" status: 204  len: 168 time: 1.1005645
May 26 15:15:22.222017 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37758) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:22.270543 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-06586b90-e19a-4e2e-a1c9-c4aecb9d8f47 admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=511d07599f124852b029e4bc01cbdd7f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0473335
May 26 15:15:22.272826 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [-] (103981) accepted ('10.222.0.81', 37762) {{(pid=103981) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:22.334378 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:22.360292 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:22.483819 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:22.488253 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-423ac6fd-ee3c-4ca1-9a0a-6287e89778ef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:22.501152 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e34e14e2-0f62-4f39-b660-0a89fe1a67c0,revision_number=None']} {{(pid=103981) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:22.504808 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG oslo_concurrency.lockutils [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:22.510009 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron_lib.callbacks.manager [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] Notify callbacks [] for security_group, before_response {{(pid=103981) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:22.511164 dv-cinder-784140-4-iscsi neutron-server[103981]: INFO neutron.wsgi [None req-9719c99a-816a-4249-9686-f3a462f26032 admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/e34e14e2-0f62-4f39-b660-0a89fe1a67c0 HTTP/1.1" status: 204  len: 168 time: 0.2374425
May 26 15:15:23.255126 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.288971 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e2937e0f-3949-4415-950d-33832ec1352e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.427253 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37770) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:23.480812 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-bb9e767d-62ef-4518-a139-304a380192ef admin admin] 10.222.0.81 "GET /v2.0/security-groups?tenant_id=a056c271765b428094429bd897256335&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0522304
May 26 15:15:23.483112 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [-] (103982) accepted ('10.222.0.81', 37774) {{(pid=103982) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 26 15:15:23.543385 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.568849 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.700308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-4001635'] for security_group, after_delete {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.704886 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-9c3ba570-930a-42b2-b692-7234d0a6be74 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 26 15:15:23.717728 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a91c68f0-9068-43de-a053-21556761fa0c,revision_number=None']} {{(pid=103982) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 26 15:15:23.720308 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG oslo_concurrency.lockutils [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 26 15:15:23.726173 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron_lib.callbacks.manager [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] Notify callbacks [] for security_group, before_response {{(pid=103982) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:23.727292 dv-cinder-784140-4-iscsi neutron-server[103982]: INFO neutron.wsgi [None req-d143dd6d-7049-4bcf-bf77-4c0f7156252f admin admin] 10.222.0.81 "DELETE /v2.0/security-groups/a91c68f0-9068-43de-a053-21556761fa0c HTTP/1.1" status: 204  len: 168 time: 0.2432861
May 26 15:15:24.106566 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:25.683353 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:29.597584 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:50.505658 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1f47f2db-fbea-4f48-b548-e1ae5a3fa71c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:52.273111 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:15:53.106863 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:53.162367 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b8ab754d-f35c-4e27-a4fc-871e91900c01 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:54.104280 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:55.715470 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:15:59.573601 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:20.504147 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-cb943046-e235-4e4d-93a5-ae5705555a81 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:23.109519 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:23.165662 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-523b1803-b9b9-4c63-85be-e725bc50df1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:24.092288 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:25.692674 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:29.272708 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:16:29.589490 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:50.531105 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-51d514e0-e915-4a2e-9bae-bd7def681bf3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:53.114002 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:53.165130 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b39eed72-cd42-4985-831b-a5af530fb8d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:54.148480 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:55.702764 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:16:59.582831 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:06.271911 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:17:20.495724 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7d14fea3-7a72-444f-aebe-7dde2901d0f2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:23.158864 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:23.186938 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-b8ac6968-5a70-4733-8cd0-4b32ad87b3c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:24.118821 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:25.707193 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:29.604382 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:43.271738 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:17:50.472697 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-d656444c-715e-4415-81fe-2cf641d44b41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:53.115546 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:53.169870 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-27819883-ff92-4454-9fae-eda6f11b1e57 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:54.111788 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:55.700102 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:59.608552 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:17:59.833450 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [req-ac2166d5-dc4e-4dde-9ea1-4b361c86e8a0 req-1b02f3f7-b4a1-4864-9184-f6514a47dff6 service neutron] (103982) timed out ('10.222.0.32', 54810) {{(pid=103982) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 26 15:18:20.270429 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:18:20.499401 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-2807194f-288c-4d20-8cd2-71fce5bf34d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:23.128280 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:23.185054 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-940a41b8-e2ca-4334-98fa-779755506649 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:24.145383 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:25.706104 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:29.630657 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:50.481701 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-7de57a01-7476-48d7-9762-8abbe0305d30 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:53.155781 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:53.184148 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-78215825-10b9-4460-8ce8-ee9b2f8b4b60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:54.207710 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:55.681040 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:18:57.269861 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:18:59.612650 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:09.024558 dv-cinder-784140-4-iscsi neutron-server[103982]: DEBUG neutron.wsgi [req-db731c09-df7f-4d87-a155-6dfd49c00b96 req-70655b89-e021-4482-a5d4-bb1d16783b12 service neutron] (103982) timed out ('10.222.0.81', 58910) {{(pid=103982) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 26 15:19:20.503676 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-fcc38181-9931-4c4c-8222-2a72a3743633 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:21.678412 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 req-1a33875d-cbb7-4caa-8ad7-59fe5e8377e2 service neutron] (103981) timed out ('10.222.0.81', 34588) {{(pid=103981) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 26 15:19:23.131801 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:23.183437 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-5fd487a7-ddb7-42ca-bf44-34052bc60603 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:24.137946 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:25.703916 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:29.640564 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:34.268937 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:19:50.543605 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-e8ff6b9c-177f-48d9-8ef9-8637b8041dc2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:53.148222 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:53.205279 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-bc1cdadb-6b0d-408a-b9e1-2cbddd29f76c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:54.131533 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:55.747680 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:19:59.616590 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a2dda3f0-4ccb-465f-b3f2-d82d305a33b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:20:11.268677 dv-cinder-784140-4-iscsi neutron-server[103984]: DEBUG neutron.db.agents_db [None req-68efb9cf-7279-47f4-a26f-237ed54cb2a1 None None] Agent healthcheck: found 6 active agents {{(pid=103984) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 26 15:20:20.490991 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-41a4c387-a096-40a4-b353-21b01116f1e6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:20:23.135307 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-927f6061-4293-451a-89ac-42099bc683f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:20:23.209405 dv-cinder-784140-4-iscsi neutron-server[103981]: DEBUG neutron.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-1a53ec73-2361-425f-95ec-85b1a1a7e87b service neutron] (103981) timed out ('10.222.0.32', 54817) {{(pid=103981) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 26 15:20:23.220908 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-1968ec9d-7d56-4a85-b97f-5e950b65ee59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:20:24.141016 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-272c44a7-990e-434d-a6bc-bbdaa4493d23 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 26 15:20:25.707420 dv-cinder-784140-4-iscsi neutron-server[103983]: DEBUG neutron_lib.callbacks.manager [None req-a098e273-788e-463c-b445-dbe0a6db6887 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8781805467639', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-857508'] for agent, after_update {{(pid=103983) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}